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PARTIAL REINFORCEMENT 


A SELECTIVE REVIEW OF 


sistana 


nkins and Stanley 
Reinforcement: A 
we, which is now a 
in the area Its 
h is probably in 
workers in the area 


ng another review of 


Lhe part il reinforce 
} mweve»:r, 18 SO large 

at su h a rapid 
that it is difficult now 


>on the 


to mai 
whole area 
w is offered, with 
midation, as an at 
least the major 
the post 1950 
rese, 
Even thoug! list of 


’ ' 
s long, this review unfortunately 1s 


relerences 


not exhaustive Some studies are not 


Tit luded because thev were believed 


by the writer to be ant, in- 


Prob 


yp» rh ips exce Ihe nt 


insignihii 
ive. or badlv conceived 


have been overlooked 


writer has made a con 


rt to read every study 


that 


orcement has 
maior: psy« holog- 


Another 


» express his ; 
of Northwester 
Tyler of 
! 


ppreci 


I ouiimna 


who read the entire manu 


idequacies remaining are not 


~d to them 


DONALD J. LEWIS? 


LITERATURE SINCE 1950! 


+ veils 
’ uy 


large class of excluded studies are 


those which involve a tree respond 
Chis exclusion is purely 
that 
to be of 


different 


ng situation 


arbitrary ind does not 


sucl 


| 
icSss SS! ili ance, nofr 


mean 
side red 
that 

will be re- 
Only 


discrete trial studies are considered, 


studies ire Col 
principles necessarily 
quired for their explanation 
primarily because these happen to be 
\ re- 


studies 1s 


of major interest to the writer 


view ot! tree responding 


badly needed. A very few studies be- 
1950 ire ct be- 


nsidered either 


parametric design or 
i to theor, 
is organized around the 


variables that 


1S paper 


jor empirical have 


heen investiga ed in attempts to de- 
ne the effects of partial reir- 
extinction. The aim in 


has been to deter- 


relations between 


ind 


studies whose 


response variables. 


primary purpose 

to test a theoretical orientation 
oO not such a determination, 
but lered to be val- 


uable apart from theirtheory. There- 


allow 
the are cons 
thev, too, are cited in the data 


Without 


these 


lore, 


tion 


theoretical 
may 


their 


ser 


context studies appear 


somewhat disjointed, but it is some- 
times salutary to look at data only in 
Other 
important pri- 


contribution to 


relation to empirical variables 


studies seem most 


marily for their 
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ire considered in the 
theory a some, of « 
i d in both 


Sia ‘ 
8 COT 


theory and they 


tion must 


Be 


~d with ex 


uTse, 
be cor 


this 


sections 
cause cerne 
ion 


lentally 


phenomena are 
' 
Perhaps a 
necessary uction to this paper 
is a thoroug! ding of the Jenkins 
and Stanley (1950) paper. The 
and problen 


Ip ag 


per 
the 
the 


J. LEWIS 


highest percentage of reward. Dur 
a? upd de 
the 


the 


ing extinction there wa 
crease in response strength for 


100%, group, and ‘ess rapid for 


others The greatest resistance 
for the 50° ,.a 
falling off for both the 


The 0 gi 


to ex 
1 75° 


, ‘ 


100°; 


tinction was re 
groups, 
25! groups oup 


shows | pr wth ally no cf 


id therefore no resista! 
then 
to extins 


41)‘ 


tio 


ol 


There was, 
resistance” 
gion between, SAV, 
inftorcement 
Duplicating im desig: 
study di 


Hornseth 


™~ ussed above (of 
1951 


situat 


and ised 
conditioning 

percentage ol 
sponses were 


ol 


with 


igain in ising 
function 


nent, 


percentage iorce 


each x emiuttiy 


ibout 


torcen 


positive responses it the same 
it received ret 
netion, however t! 


gre itfeat 


ind Dun 


ified so that 
trolled. Each 
to the Ss. 
were 100°, 
12.5‘ und 0%. The tot 
plays to quitti fou 
inverse function of the percer 
the 100°, Ss 
the 0 Ss quitt 


no evi te 


gy was 
reward with 
rst and 
There was 
shaped functior 

In another experiment, with , 
11%, 33%, 67%, and 100° 
Lewis and Duncan (1957 


Ss to state for each trial of the 


reward, 
d their 
9-trial 


iSK« 


tion series their “expectation” 


g or not winning on the next 


[hese *xpectancies were quan 


tihed or a scale from 1 to 6. with 1 
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revresenting a firm expecta vy of not 


winning and 6 a firm expectancy ol 


winning. The results showed that ex 


pectancres were a regular function of 


both 


extinction 


reintorcement 
j 


iv acquisitior and 


ind that the 


percentage ot 


ex per tancyv of winning 


lropped off vie du 


the group that quit first. In 


there was a slight drop for 


stingaf shaped 


ere 


ipproximately 
half 


ial reintorcement 


ix and one 


sas Trew ird 
ou, 
sition series 
resistance 
50°. and 
the 100° 
the latter 


SOOT 


nave been consider 
plotted at 


sion 


1952 
1951 Lewis (1952 

Duncan 1957 present 

: N-shaped fun 

yns at both the high 

iC Because a non 

nection usually means 

two processes are operat 

‘ | 1952 

to what 


be The 


pothesized, is a 


Schipper 


these two pro 


iirst process, 
discrimina 
The higher the 
the 


percentage 


nforcement, more the ac 


” 


‘stand out 
from the series, and the 
less PRI \ discrim 


ination process thus results in a de- 


cuisition series should 


extinctio 


should result 


creasing i i as a result of per- 


ment e “. 


With a 


se starting close to zero re 


niofgr 
ond process 1s i le Pring’ Of 


strength, the greater the per- 
tage of reward, for equal numbers 
trials below some limit, the greater 
gth hus the 


response stre! 


ing process produces an increas- 
ng function, and the discrimination 
process should produce a tre! din the 


The combination 


i Nn sh iped 


opposite direc 
these two ré ilts 
pper ire correct 

of the N would 


the de 


the dis 


operation 


be give 
wes, but with 
than 100 the pattern 
W im OU rein 
rewards may be 
but 


regularly \r 


may 
reement, 
the 


Lmipie 


randomly, irregularly 


lomly, or 


imber of regular patterns 


| ire poss 


ble depe riding on the length of the 


icquisition series \ systematic ex 


ploration ol these var 


} iceded 


1950 


ibles is 
(srant, Riopelle, and Hake 
alternatior 
DA i 
naition 


set up random (R), single 
SA double alter it 
100 o groups in 


ing situation \t 





4 


tion the 100‘ 


about equal and superior 


and SA grou 


ind the IR groups were 


to the DA 


Ds 
t 


During extinction 


the R group showed a very rapid de 


crement in 
ended be low 
of the 


extil 


rm 


is 


’ 
} 


t 


) 


other 


wi 


* 


t 


*? 


ude 


and 


rhis 


They 
number 
the 


forced trials 
both the 


therelore 


varied ta 
ol 
number 


blocks 
of tr 
from nonreinforced 
trials and the 1 


blocks 


combu 


ses per 

umber rf 
necre ised 

Hake t, 1951 


uation 


& (ora 
gy sit 
results were 
ol 


iuse the 





the 


is more 
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other two, 
resistant 
grou] 
‘ SC TICS 
more resi 


} group w he 


and the RI 


to 
», it 
ends Ww 


tor 


extine 
secms, 

ith 

Stant 
| 


with 


the 


, that SA results 


if 


Kr 
eT 
It 


ol no 


number 


thar 
iuskopf, & 
Wortz, & 


seems 


tion 


also 
nreintorced 


of times 


with 
superior to continuous reinforcement 
and 
nonre 
Radlow, 1957 
seth, 1951 


about patterning 


at least one reinforced trial are 


to those blocks which end in a 
Grosslight & 
, & Horn- 
known 
the 


their 


trial 
Hake, (srant 
Little 


be cause 


inforced 


more is 
even 
more obvious variables and 
not been studied 
In the 


repre- 


combinations have 


Secondary reinforcement 
following discussion, S*® will 
sent a neutral stimulus serving as a 
stimulus whi h Is pre 
And S' 
julus used as a 


forcer »' 1s 


discriminative 


sented before the response 
lt 


will represent the stir 


secondary rei presented 
iter the re 


; 


sponse whose strength it 
} 


maintain 
GR ie 


oped to stret en ofr 


reintorcement or- 
to make a stimulus 
7. ind S* may be 
ng to many different 
There are thus three 
he S', and the S®, 


necessar,r ‘ 


pre 


ianipulated somewhat 


a result there 


partial reinforce 
h of 


“acn these 
about different results, 


ways 
the 
relationship ot sec- 

t to partial rein 


ites 


nto the num- 
ber of experimental designs by which 
the three may be combined 
7 nree ipal 
May be used dur 
t . ent 
S® and S 


pring experimental de- 
ng acquisition 


ol 


Design 


presenta- 
\-1: Pri 


given only 


ize 
ot 
reinitorcement is 


d S* 


irs 
is presented 
Design A-2 
is given, S*" is also pre- 
when S® is 
Design A-3 


1s presented on a certain 


part of the time a 
every sion 
Whenever S® 
sented, but 


neither is S" 


on oct 


not given 
Primary re- 


inlorcemen 
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TABLE 1 


Reinforcer 


Experimental 
Design SR S 


partial continuous 

partial partial, contingent 
m S® 

partial partial, not con- 


tingent on S® 


percentage of trials and so is S", but 
the percentages varied in- 
dependently so that S® may coincide 
with S*® and it 
are 


two are 


I hese de- 
Table 1 


Because the effects of “partial ser 


may not 


signs represented in 


ondary reinforcement" can only be 


determined when compared to “con 


tinuous secondary reinfor« ement,”’ 
which 


comparison 1s made will be cited in 


only those studies in such a 
this section 

In addition to these general meth- 
ods of combining primary and secon- 
dary reinforcement are two general 
methods of presenting S* during ex 
the test 
pre sented on every 
trial Design E-1! or only on part 
of the trials E-2 The 
studies available in this area will be 


the 


tinction, or during trials 


The S’ may be 
Design 


classiMed according to design 
used 
There seems to be only one st idy 


\-1 


used a 


in which Design has been used 
1956 


acquisition, 


Peterson runway for 


ind a buzzer was pre 
sented on every trial just as the S en 
chamber Peterson 


tered a delay 


was also interested in delay of rein- 
torcement Tests for the effective 
ness of S’ were given in a bar pressing 
S had pre- 


Perhaps this proce- 


device in which had no 
vious experience 
dure does not fit the usual paradigm 
for extinction, but as a test for the 
effectiveness of a 
forcer it 


dinary extinction 


secondary rein 


is certainly superior to or 


Peterson found no 


difference between an S' associated 
with 50% 


associated with 100°, 


reinforcement and one 
reinitorcement 
that 


etlects oc- 


There is also no evidence any 


secondary reinforcement 
curred with either percentage 

Notterman (1951 
ber of nonreinforced trials in a run 
the 
trials held constant 
light as S* 


just 


varied the num- 


wav with number of reinforced 


He preset ted a 
trial 
(in 


on each reinforced 
as S entered the goal box 
nonreinforced trials S*® was not pre 
Notterman used De 


Certain of his gro ips were 


sented Thus 


\-2 


extinguished to 


sign 
then 
(although Notterman’'s argument for 
this is not as firm as would be desir 
the absence of S Then S' 


reintroduced tor 


the same level 


able in 


was further trials 


but no reward was given 
, 


Response strength increased as 


primary 


rect tunction ol the iumber ot 


inalls interspersed nonreint 


[™ rcoentag 


trials. The smaller the 


reinforcement, the greater the efte 
ess ol the Ss’ 


The srl alle sf pet 


reintorce ent 1s ] was 


tiver 


centage of 


, 


33 


‘ 


N h is bec 


4.3 It is, 
that if 


combined with Desig: 


No study n reported 


Design howe vel 


’ 


abie o Ly Sign 


E-2,5S 


guess 
most eficacious in maintai 
sponse or bring Kx One abe 
Three designs for con b 
tial reinforcement with se 
been 
little « 
found n 


have 


Design \ l, 


1956 


inforcement 
For 
Peterson 
for secondary reintforcet 
standard contre 
1951 


nice 


in a 


Notterman with an 


sign and a parametric st 


found greater effectiveness for S' with 
smaller percentages of reinforcement 
Design A 

Successwe acquisition 


id ¢ 
group ol 


3 is untried 
and extine 


lion Perkins a! icioppo (1950 


gave one animals 16 ac 
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quisition trials, only 8 of which were 
rced, followed by 30 extinction 

Seven days of this kind of 
training were given. A second group 
the succession of 


except 


reint< 
trials 
received same 
that all 
reinforced 


events acquisition 


The 


Ss were more 


results 


trials 
showed that the 50% 


resistant to extinction throughout the 


were 


extinction and the rate of 


sequel ces, 


extinction increased with successive 
extinctions 

Lauer and Estes (1955) used a 
jumping stand and gave three series, 
each of 14 acquisition and 8 extinc- 
tion trials. For one group the first 
icquisition series was with 100° re- 
the with 50° 
und the third with 100% again. The 


other group started with 50% and al- 


niorcement, second 


ternated or 
They found 


trons resulted in less 


SUCCESSIVE 


that 


acquisitions 
successive extinc- 
extinction, both 

level Eexting 


rate and terminal 


tion rates were similar after 50°, and 
except that 
decrement on 


tinction day 


there was a 
the first ex 


100%> rein 


100° 
greater 
following 

iorcement 
Lauer and 
that 


nections had 


Estes (1955) pointed 


successive acquisitions and 
a great deal in com- 
with typical partial reinforce- 
that nonreinforced trials (ex- 
reinforced trials 


1955 


follow 
ns Razran has 
The main dif- 
the 


sequence of reinforced 


e this pow t 


ference betwee the two is in 


length of the 


ind nonreinforced trials, which ac- 


tually makes successive acquisitions 


and extinctions identical to the pat- 


terning of partial reinforcement 


Pursuing this comparison of succes- 


sive ind extinctions to 


acquisitions 
pattern of reinforcement, Lauer and 
Carterette (1957) gave one group suc- 
(A-A) 


inother group received successive ac 


(A-E 


cessive acquisitions only and 


quisitions afi extinctions 


Both groups received spaced trials. 
The A-A group was presumed to be 
analogous to 100% reinforcement and 
the A-E group was presumed to be 
analogous to 50% reinforcement. 
They found that the mean starting 
speed of the A-A group on all re- 
acquisition series was below that of 
the A-E group, even though the for- 
had had 
This is a very 
Its typical 


reinforcements. 
finding 
reinforcement 
that the 
reinforced trial following a nonrein- 


mer more 

interesting 
partial 

should 


counterpart show 


trial would be 
reinforced trial following another re- 
trial Amsel (1958) pre- 
to indicate that this is 
Amsel interpreted his 
that 
forcement has a frustration-drive ef- 


forced superior to a 
inforced 
sented data 
what happens 
findings to indicate nonrein- 
fect which serves to energize the be- 
havior on the next trial. However, it 
is hard to the frustration- 
drive could persist over the 30-min 


see how 
intertrial interval used by Lauer and 
1957). It. is just this ef- 
fectiveness of partial reinforcement 


( arterette 
procedures on widely spaced trials 
that is most difficult to interpret 
The Perkins and Cacioppo study 
(1950) showed decreased resistance 
to extinction with successive extinc- 
both Lauer 
(Lauer & Estes, 1955; Lauer 


1957 just 


studies 
& Car- 
the re- 
It is interesting to note that 


tions, while 


terette, showed 
verse 
other successive acquisition and ex- 
Bullock & 
report findings similar 
The reason 


tinction studies e.g., 
Smith, 1953 
to Perkins and Cac loppo 
for the difference in results lies per- 
haps in the shortness of the extinc- 
tion series in the two Lauer studies, 
8 trials in and 12 in the 
other. The other studies in this area 
used a much longer extinction period 

In any the Lauer 
point the way to a considerable con- 
solidation of partial reinforcement 


one case 


case, studies 
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variables, in that successive acqulsi- numbers of icquisitio 
tions and extinctions can be con- terent percentages ol 
sidered as an aspect of the pattern They found no intera 
ind percentage of reinforcement. If tinction for the two var 

1y intertrial interval phenomena larger number of acquis 
should turn out to be reliable, they in both cases, resulted 
should also show up as a function of _ tinction. Capaldi (1957 
the interval between the successive studies reports a ver 
acquisition at 1 extinction series the more icquisitior 

Vumber of trials. Onilv afew studies’ the extinction. | 
have been concerned specili illvy with ( ipald combined 
the relationshiy between partial re I 
inforcement and the number of a Some Ss received 
quisition trials A large imber o other trial, and 


studies (e.g., Jenk Stanlev. wards randomly 


1950) however, have shown ut warded, long acq 


quisition responding i tinguished faster thar 
100% than with partial 7 rewarded, short 


ment. A study by Weinstock (1958 an taster 


} tar 


amplifies this statement so that 
holds only for the early ct 
stock gave 109 
nd, for the later t: 
‘ntaye groups were 
than the larger 
no regular ¢ 


there 


ber 
Wein < reports the 


clear evidet 


lower pe 
groups inally, Weinstock 
signif 
late in il 1oO1 ior 
group » are faced here 
anom 
for contint 
rewards depress 
late in acquisition 
increase response strength late 1 rded grout Also 
tinction evidence that his er 
Lewis and Duncan (1956a, 1958a at the end of acquisiti 
in two studies combined different Spontoneous recovery 
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litth information about spontaneous 
as affected by any variable, 
little known 
the effect of partial reinforce- 
Per- 


Ww hose 


recovery 


and certainly there is 
about 
taneous recovery 


(1950 


ment on spo 
kins and ({ 


study has 


id 1Oppo 


been briefly described 


above, comment simply, ‘“‘spontane- 


recovery was complete before 


Notter- 
(1952) 


means ol 


reconditioning trial 
man. Schoenteld. Bersh 
rate by 


and 


conditioned 


heart 


electric shock he partial group 
showed no evidence of extinction al- 


the did. 


No Spor! taneous recovery Was possi- 


though continuous group 


ble for the partial group, nor was a: 


uous group 


1956) with a straight alley 


o differential effect of partial 
1 spontaneous re- 


neous recovery x 


covery 
curred for both parti il and continu- 


ps. I 1955 


if and Estes 


sue! 
found spontaneous recovery occur- 
to day following 100% 
but not following 50°, 
1 decrement in re- 
blocks for the 
it recovery seemed to 


d uils blo« ks 


evidence is 


was 


d uly 


too 
onflicting to warrant 
ision about the efiects 
niorcement on spon- 


1 the avoidance con- 


S can avoid 


nt by an 


appro 


‘ respol “et 
juisitior S wets 


the trials and not on others, a partial 


Thus, early in ac- 
punished on some of 
procedure In the escape learning 
S$ gets the punishment no 


situation, 


matter what he does, and this is a 


continuous procedure. If, as is com- 
monly conceived, shock offset is re- 
inforcing, one would expect, from the 
reinforcement, 


pro- 


prim iple ot parti al 


that extinction would be more 


longed after avoidance conditioning 
than after escape conditioning. Jones 
(1953), Logan (1951), and Sheffield 
and Temmer (1950) have shown this 
to be the case. Jones (1953) has also 
shown that an “intermittent escape” 
schedule, that with- 
holding punishment on some trials, 


one involves 
results in greater resistance to extinc- 
tion than orthodox escape. Wynne 
and Solomon (1955) have pointed 
out, in addition, that the avoidance 
extinction situation actually involves 
further learning of the instrumental 
They two re- 

earned during the ac- 
the instru- 
mental response and the other is a 


response argue that 
sponses are 
quisition series, one 1S 
emotional 

rhe CER has a longer la- 
than the instrumental re- 


and on the in- 


conditioned 
(CER 
tency 


response 


sponse, most trials 
strumental response occurs before the 
CER can begin. The S is removed 
from the conditioned stimulus before 
the CER can be evoked. On 


trials, however, the latency of 


some 
the 
instrumental response is sufficiently 
long for the CER to occur, and thus 
the 
reduce 


instrumental 
the 


response 


response serves to 
CER, and the instru- 
is reinforced. Be- 
cause this type of reinforcement oc- 


mental 


some of the trials, the 
actually 
extinc- 


curs on only 
instrumental response is 


partially reinforced during 
tion 

Interirial interval. Shefheld (1949) 
reported evidence to indicate that 
the PRE obtained if the 


acquisition interval was massed (15 


( ould be 


sec.) but not if it was spaced (15 
“aftereffects” 


Since 


min and gave an 


interpretation of her results 
based on a 


her conclusion is pre- 


sumed interaction between percen- 
tage of reinforcement and acquisition 
interval, the analysis of variance was 
the appropriate statistical technique. 


Her analysis by means of t was, how- 
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ever, suggestive of her conclusion. 

Two attempts to replicate the 
Sheffield study have been reported by 
Wilson, Weiss, and Amsel (1955) 
They tried to manipulate’ the 
strength of the aftereffects of re- 
trials by using dry 
water in 


warded food in 
one experiment and the 
other; Shefheld had used wet mash 
The obtained by Wilson, 
Weiss, and Amsel were in sharp dis 
with Shefheld 
reinforcement conditions 


results 
agreement those of 
The 50% 
led to greater resistance to extinction 
the 
[here was no significant in- 


independent of 
terval 
terval by 
either by analysis of variance or anal 
ysis of covariance. Lewis (1956 
replicated Shefheld’s experiment ex- 
cept that he used a 2 min. distrinuted 
interval. He obtained essentially the 
same results as those of Wilson, Weiss 
and Amsel. Again the PRE was ob- 


tained whether or not the acquisition 


acquisition in- 


reintorcement interaction 


also 


trials were distributed or massed 

With an 
paratus, Grant, Schipper 
(1952) used a 2&2 x2 
sign similar to that of Shefheld except 
that the intertrial intervals were 10 


conditioning ap 
Ross 


factorial de- 


evelid 
und 


sec. or 40 se Che extinction results 
were quite complex in that there was 
a triple interaction among the three 
variables of the The 


authors interpreted this interaction 


experiment 


to mean that the superiority of the 
50% groups during extinction was in 
creased when there was a change in 
the distribution of trials from acquisi- 
tion to extinction 

rhe Shefheld design was also used 
by Grant, Hornseth, and Hake 1950 
in a light-guessing experiment using 
a Humphreys’ board (Humphreys, 
1939). The intertrial intervals were 5 
sec. and 45 sec. Again the PRI 
obtained independent of the acquisi 
Iyler (1956 


was 


tion interval in a dis 


crimination situation found the PRE 
after a 15 min. acquisition interval, 
and Weinstock (1954, 1958) in 
studies found the PRE after a 24-hr 
trials 


two 


interval between acquisition 


The only study not showing the PRE 
was 


after spaced acquisition trials 


that of Rubin (1953), but it is im- 


possible to separate the effects of the 


intervals from possible other effects 
such as those of secondary reinforce 
ment, and little 
from this study. 

he cone lusion seems to be rather 
firm that the PRE obtains whatever 
the spacing of the acquisition trials 

Drive. There are only 
directly relevant to the 
different drive levels on partial rein 
One by Lewis and Cotton 


can be cone luded 


two papers 


eftiects ol 


forcement 
(1957) is essentially 
1, 6, and 22 hr 
with 50 and 100% 
each drive level, they found that the 


negative { sing 
of food deprivation 
reiniorcement tor 
interaction between the two variables 
did not attain significance 

The other 
variable is that of Linton 
(1951 
received 
either 
Each of 


divided into two groups during ex 


relevant to this 
and Miller 


rats 


study 


[wo groups of hungry) 


acquisition training th 


‘ 


100°, or 50% reinforcement 


these two groups was sub 


tinctio one ol ear h pat be 


tinguished while satiated 
under the acquisition adr 
appropriate tor 

the 
analyzed by I he 


dicated that the group partially re 


though 
Variance, 
i tests 


analysis of 


forced and extinguished under the 
same drive as used during acquisition 
was more resistant to extinction than 
the other three, which were not dif 
ferent from each other. In part, the 
results were interpreted in terms of 
generalization An 
had to 


Irustration 


drive-stimulus 
other part ol the « xpla lation 


do with the absence of a 
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drive for the partial-satiation group 
It was believed that 
the frustration drive for the satiation 
group prevented the PRE from ap- 


the absence of 


pearing 
Because a motivational interpreta- 
the PRE is not 
1958 


tion ol uncommon 


\ Amsel, 


nec ded 


studies are 
with dif- 
reintorcement 


more 
combining drive 
ferent schedules ol 
Discrimination. In one sense, all 
studies using a choice situation and 


the noncorrection method involve 


partial reinforcement, because an in- 
correct trial is never reinforced. As 
the number of correct trials increases, 
so does the percentage of reinforce 
Lewis and Cotton (1958) have 
pointed out the complexity of the 
T maze as far as partial reinforce 
ment is concerned 
the stem of the T maze each have a 
different percentage of reward obtain- 
ing The 
100%, 
is rewarded 0°%, and stem is rewarded 
low 


ment 


The two arms and 


correct arm is rewarded 


of the time. The incorrect arm 
during 
100°, as 
Discrimina- 


it varving 
the e arly 


the response 


percentages, 
trials and almost 
1s learned 

tuations have thus afforded a 
ul. arena for the study of partial 
ent But 
so commonly used and 


reintorce! because choice 
Ss ire 
partial reinforcement is such 

ve variable, studies are 
out the effect of the 


reward in 


tease 

ifferent 

the different sections of the appara- 
is \ta 


ning speeds should be 


percentages ot 


minimum, extinction run- 
determined 
separately for the stem and two arms 
of the T maze 


sirable to duplicate in a runway 


It might also be de- 
the 


pattern of reinforcement usually ob- 
tained in the stem of a T 

Some information about partial re- 
from re- 


inforcement is available 
sponse reversal studies, even though 


response reversal does not qualify as 


an orthodox extinction operation 
Wike (1953) showed that a re- 
sponse acquired under conditions of 
partial reinforcement is more resist- 
ant to reversal training than a con- 
This 
finding has been confirmed by Gross- 
light and Radlow (1955), Grosslight, 
Hall, and Scott (1954), and Kendler 
and Lockman (1958), but not by 
Buss (1952 
Babb (1956) 
irrelevant stimulus 
reward 70% of the 
later performance when the irrelevant 
When 


the irrelevant stimulus is associated 


tinuously reinforced response. 


that an 
with 


has shown 
associated 
time facilitates 


stimulus becomes relevant. 


with reward 50% of the time, it has 
When 
of the 
time, later learning is inhibited by 
this previously irrelevant stimulus. 
In general, partial reinforcement 


no effect on later learning 


associated with reward 30° 


retards later response reversal. 
Generalization and complex stimuli. 
In a study investigating the gradient 
of primary stimulus generalization to 
tones, Wickens, Schroder, and Snide 
(1954 conditioned gal- 
vanic reactions to one of three tones, 


established 


each of which was separated by 25 
jnd's. For one group, in addition to 
the tones, a click was randomly pre- 
sented 12 times without reinforce- 
ment 

During test trials a gradient of 
generalization found for the 
group without clicks, but no gradient 
was discovered in the group with 
clicks The failure to obtain a 
gradient for the click group seemed 
attributable to a generally high re- 
sistance to extinction. 

Other evidence is available (Brown 
1947) to indicate that the generaliza- 
tion gradient is very broad on the 
first becoming sharper 
with further test trials. Because the 
test trials are usually nonreinforced, 


was 


test trials, 





a by-pre 
ot extinction iriable which 
creases resistance to extinction 
should, then, decrease any generaliza 


tion gradien From this, one would 
conclude that partial reinforcement 
should increase the amount of gen 
eralization, which is indicated by the 
Wickens, Schroder, and Snide (1954 
study. Further evidence on this im 
portant problem is needed from other 


experiment il situ 


The experimel 


itselt”’ 
p. 257 


experin t (Wickens & Snide 

was undertaker test this 
pothesis directly 
cedure consiste 

which « 

Iwo groups were 

wuished to this 

For the experi 


the other aspect 


pothe sis 
ide | ward Lew S 
1956b combined 


Wal 
was 
significal I between showed 


amount “vA the five dif delays were 
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were 0 and 9 ses Least resistant to extinction was the 


t he 
Wike (1957) used a T 100° no delay group 


ive one group im nediate In conclusion, it seems that partial 


correct trials, another lelavs of 30 sec. result in increased 


the 
of the resistance to extinction, but partial 
10 sec. or less do not. The 


more than 25% 


delays on half 
ind a third group 30 delays of 
n half of the correct delays must occur on 

nd when partial rein- 


lhe results were essentialls of the trials. a 


3 forcement is combined with partial 


cIeT, 

k ap delay, resistance to extinction is the 
variable delay, yreatest. 

Feher (1956), Situati ing established an 

t smpiri nomenon in one experi- 

we take some pra 

netimes theoretical, in- 

tk variety of 

itu phenomenon 

(One group W is de- Ol n this section an attempt will 

to review quickly some ol 

t experimental situations 

PRI has beet explored 

All delays wi 1952) used children in a 

er trials ! il situation The re- 

owboys and, in 


the oth 
mmediately , | é 
were 


and 0°, ol 


uy nguished taster 


two, which were not vel ; Or 
trerent Apparently, he time was no difference in 
ved on n ore thar the 50! and 60%, 


PRI to o f . nor betwee! t > 100°, and 
to know ‘ groups, but » former two 


uperior to the 


eresting 
ion betweer roups were s 
Fattu, Mech, and Auble 

ned partial measured the 
extinction 

) 


orcement 

experiment (ine 5 
forced on every trial forcement he “> group was con- 
Another also had f y the most resistant to ex- 


with delavs on i! i , followed by the 50‘ and 


20, and 30 sex 100°) grou in that order Fattu, 
Auble n lech 1955 were not 


‘ 
i 


50 reintorce- 


( 
0, 10, 20, and peat their results although 


wrced trials \ * same trend was apparent 
Rabaiola (1952) had Ss 


reinforcement (,08s and 
nonsense syllables 


the reinforced trials “arn one of three 


group with delay was most to a color stimulus Che correct .°- 


100°, sponse was reintor ed with a buzzer 


roup with delay and the 50°, group 100%, 75%, and 50% of the time 


iv were about equ ul and for the different groups The speed 
ment of a criterion of learn- 


extinction The 


. 


resistant to extinction 
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ng function of the 
After the cri- 
terion was reached the reward condi- 
Half of each 
acquisition group was given UO re- 


ing Was ahi increasi 


percentage ol reward 
tions were switched. 
ward, and the reward percentage was 
the other Che 
correct 
the 50° 
100° 


halved for mean 


number ot responses ae- 


and 0% 
to U' 


creased faster for 


group than for the 
group. Thisrur 


PRI 


port an increase in 


‘ 


ter to the usual 


s coun 
Also, Goss and Rabaiola re- 
correct responses 
ifter about eight trials of no reward 
his Ss 
i series of words to which they 
The 
orrect number was one less than the 
number of He 
reinforced his Ss either 100°, or 67° 


Hirsch (1957) presented 
with 
were to respond with a number 
letters in the words 
the time for the correct responses 


reinforcement was omitted alter 


Again there 
Perhaps, if 


riterion was attained 
PRI 


~ persistence . tl 


was no significant 


more of a easure ol 
extinction had been used in these two 


studies, the typical PRI 


occurred. 


would h ive 


Spivok and 


percentage 


Kanfer ind 


Papajohn varied 
iutokineti« 
S's 


ot reintorcerme il 

situation \ f of 
movement 
Kat 

fer rewarded these responses at 100°, 
67°, 50%, and 0% for different 
but the 0% g oup 
same criterion of performance 
Che 


the 


verbal statemen about 


was selected for reinforcement 


‘ 7 
Dringing all 


rew ard was removed 
il PRE was 

number l"" re- 
the 


iwareness ol the re 


was found in partial 


vrouDp The S's 
essential 


PRI ! r ilso 


the rate of 


inforcement was not an 


condit nn 


for the 


pointed out that extin 
y be as important as the total 
ol responses emitted Spivok 


1957) compared 100% 


tion n 
numb 


and Papajoh: 


i. LEWIS 


reinforcement with a variable inter 
val schedule, finding greater PRE for 
the latter 

Finally, Lewis and Cotton 
found the PRE in a T maze with a 
Their 
reiniorcement 
the 


on 


1958 


correct turn response measure 
had 
administered by being placed i 
with 
o of the placements 
both the 50% and 100% 
worse than a control group that div 
not 


animals partial 


goal by hand food present 


50 However. 


groups were 
reiniorce 


receive nonresponse 


THEORY 


the 
reintorcement, 
1950 < 


In 1950, 
theories of 
Jenkins 


merated 


discussing various 
partial 
Stanley 


essentiall, 


nr 
mii 


and 
hve different 


theories These were a response 


aftereffects, (c) discrimina 
reinitorcement, 


All ol 


remain today as viable entries in the 


secondary 
ind expectancy these 
partial reinforcement sweepstakes al 
though 
is rarely 


the response-unit hypothesis 


used for discrete 


trial phe 


i id the ex per tancy h | 
h battered ol 


nomena, 


thesis has been mue 


late and seems to have no articulate 


In addition, 


two new entries since 1950 


supporter remaining 


there are 
These 
theory of Weinstock 
Hulse 
5b) a mediating response theory, es 
Amsel (1958 Kendler, 
D'Amato (1957 
ind Kincaid 


ire a 1 competing response 
1954 ar d one 
Stanley (1956 and 


by and 


poused by 
Pliskoff, 


Logan, 


ind 
1956 


and 
Be er, 
among others 

iflereffects. One of the first, 


and 


probably still as good as any, state 
ments of the aftereffects theory is that 
of Shefheld (1949). She pointed out 
that the aftereffects of reinforcement 
different the ilter 


When 


nave a 


are quite irom 


eftiects of nonreintorcement 


reiniorcement occurs, S would 
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food taste in the mouth, perhaps food 
particles, and still other stimuli asso- 
ciated with eating. After a nonrein- 
forced trial the aftereffects would in- 
Ob- 
viously the stimuli following nonrein- 
very different 
from those following reinforcement 
If the 
reinforcement are still present on the 


clude frustration, searching, etc. 


forcement would be 


stimulus aftereffects of non 
next trial, and the next trial results 
then the instru- 
mental running response would be 


in reimlorcement, 


conditioned to the aftereffects of non- 
reinforcement, and the S would ac- 
tually learn to respond to the stimuli 
Since 


tinction stimuli are those of nonrein- 


of nonreinforcement the ex- 
forcement, S has learned to respond 
during extinction. Those Ss who are 


rewarded on every trial never have 
the opportunity to respond to non- 
thus have 


not learned to respond to extinction 


reinforcement cues and 
stimuli 

But this is only the learning factor 
ol the aftereffects theory as Shetheld 
describes it. There is also a primary 
kor 
the advent 
ol extinction introduces new stimuli 
for the 


reintorcement 


generalization factor the con- 


tinuously reinforced Ss, 


first time, those from non 


With the 


there 


introduc 


tion of new stimuli will be a 
response decrement due to primary 

For the 
there would 


introduced with 


stimulus generalization 


p irtially reinforced Ss 


be no new stimuli 


extinction, since nonreinforcement 
had occurred repeatedly during the 
acquisition 

lo demonstrate the adequacy of 
her reasoning, Shefheld ran 50°, and 
100°; factorially 
with massed and distributed acquisi- 


With trials the 


nonreinforced trials 


groups, combined 


tion trials massed 
atterefiects of 
should still be present at the initia- 


tion of the succeeding trial, as the 


With 


trials this would not be the case. 


distributed 
Her 


theory requires. 


results probably confirmed her theory 


for the PRE seemed to appear, as 
tested by ¢, only after massed trials 
and 50% 

Following 
Shetheld's hypothesis, Grosslight and 
Radlow (1955) and Grosslight, Hall, 
Murnin (1953) found that 


eral series of trials in which a single 


reintorcement. 


some implications of 


and seV- 
nonreinforcement is followed by rein- 
forcement would result in the PRE, if 
the 
by a reinforcement 
terpret their 
Shefheldian 

that the altereftects ol 


forced trials are presumed to be con- 


nonreiniorcement were followed 
Ihe authors in- 
results in terms of a 
aftereffects theory, in 


the nonrein- 


ditioned to the instrumental response 
followed by 
should be 


hypoth. 's 


a rein- 
noted 


bec ause the, are 
but it 
discrimination 


forcement, 
that a 
would handle the results equally well, 

Linton and Miller (1951) found no 
PRE when extinction, alter partial 
reinforcement under normal depriva- 
tion conditions, was carried out under 
and 
each 
this was 


different 


conditions of drive satiation 
the 
They 


there 


with reward 
trial 


because 


present on 
that 
very 


reasoned 
were 
aftereffects occurring during satiated 

that the 
had not been 
ditioned during acquisition to these 


“extinction” and instru- 


mental re sponse con- 
atteretiects 

As noted 
trial 


Amsel 


in the section on inter- 
Wilson, Weiss, and 
repeated Sheftield's 


minor variations 


interval, 
{ 1955 
with 


study 


and without her results. 


twice, 
In one case 
the variation was such as to enhance 
the aftereffects In the other, the 
variation served to reduce the after- 

the 
rein- 


effects, but in neither case was 


massed acquisition-partially 
forced group more resistant to extinc- 
(1956) also repeated 


tion Lewis 
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Sheffield’s study using a 2-min., in- 


stead of a 15-min. spaced interval 
rhe graph of his results appeared to 
be Shefheldian, 
statistical analysis showed no signifi- 
effect 

Continuing the attack on the alter 
(1956) found 


discrimin 


but the appropriate 
cant 
effects hy potheses I vler 


the PRE in a 


tion even after a 15 


ition situa- 
acquisition 
interval and, even more devastating, 
Weinstock, on two 1954, 
1958) has found the PRE even when 
spaced 24 


his suggests that long 


occasions 


acquisition trials were 
hours apart 


range alterefiects are more important 
than previously believed 

Wortz, and Bitterman 
ed that if Shefheld were 


1 simple pattern 


reasol 

ilternati ig 
nonreiniorce 
PRI 


be cause al- 


ement with 


should give a greater 


random patter 
the 


follows rei 


mn maximizes number of 


if nonreintorcement 
forcement “ir results showed 


the opposite; alternation resulted in 


quicker extinction than did the ran 
dom pattert 


Another 
‘ffects theory 
Brow! 
ward were del ived 


the 


ingenious attack on the 
was performed by 
_and Bitterman (1951 

ifter each 


‘ 


argued, ilteretiects tor 


succeeding trial would always be 


re lorcement hey com 


roup which received delay of 
me of its trials and 

rew urd T 

group that 

ward on all trials 


ithers with 


received immediate re 


Che partial delay 
group show “«d] the PR very nicely 
1956 Logatr Beier, and 


Wike (1953 


results of Crum 


Peterson 
Kincaid (1956), and 
have confirmed the 
ind Bitterman 

1956 


Browr 
Feher 


terestil 


performed some in- 
the delay of 


She ( ompared del iVvs 


g Variations on 


rew ard given 


before the reward with delays given 
after the reward For the latter, Ss 
were simply left in the geal box for a 
She found 
that both delay groups extinguished 
slower than groups delay 
And the delay reward grouj 


extinguished slower 


specified period ot time 


without 
before 
tha the delay 
after-reward group, again ¢ 

an alterefie 


Katz 1957 three gr 
animals in a of the 


The 


two quite difter 


notior acquisition 
given 

One trial was given on 
way, followed immedia 


on the second runway 
P-( “ iven part 
ment of 
tinuous reiniorcen 
A second group (( 
the reverse 

on the first and part 
The final group { -( 


t wous reinforce 


For the [-( re 


] 
reintorced triais occur't 


wavs 
runwav were followed 


trials in the id rur 


seco 
up there w 

lorcet 
were vi 
The result 
the C-P was sl t 
follows i by the P-( 
( -( extingu 


slowes 


group 
This would indi 
than 
mportant ir 
Ihe only conclusion tl 
drawn from these exper 
that, at Shefheldiar 
are not important cor 
PRE, 
effect 


Discrimination 


pidly. 


factors ilteretiect 


Dest 
and the probably 
wha weve; 

I he 
which was 


Mowrer 


tion theor 


first advanced by 
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1945), has had the advantage of be- 
than the 
and the longevity 
is apparently 


ing less specifically stated 
aftereffects theory 
of a theory inversely 
related to the specificity with which 
it can be stated and tested. In general 
the discrimination theory states that 
resistance to extinction 1s a function 
of the the 


stimuli to the extinction 


similarity of acquisition 


The 


the stimulus conditions 


stimul 
more § nilar 
the 


are in two ait 


the 


the greater 
rhe 


problem then becomes one of stating 


uations 


resistance to extinction 


ind demonstrating the variables of 


which similarity be said to be a 


may 


Once lawful relationships 


ire obtained between similarity vari- 


ibles and behavior, any controversy 


over whether d nination theory 
1 perceptual r reiers to some- 
on in the rat's mind, ts 
The m task for is- 


theorists, then, 1s one of 


thing POX 


superfl 10us 1107 
crimination 
lly what variables de 

the most vigorous sup- 


the discrim 


been the 


nation hypoth 
Texas group, al 
though their research has been aimed 

it disproving the aftereffects 


than it has at giving support 
Longe 
Krauskopf, and Bitterman 


Ivler, Wortz, and Bitter- 


showed that a simple al- 


1 discrimination theory 


necker t 


aattern of reimlorcement 
nforcement resulted in 

m than a random 
was contrary to 


theory, they argued, 


there must be come serial patterning 
that occurs, enabling Ss to discrim- 
and to 


when it 


inate the ae juisition series 


quickly 


stop responding 
ccAanm> 

Bitterman, Feddersor, and Tyler 
1953) and Elam, Tyler, and Bitter- 
1954) gave rewards in one end 


' ' 
Pihelll 


box and nonrewards in a very dif- 


lerent one One group was extin- 
guished with the rewarded end box 
present and another group was ex- 
the nonrewarded 


the stimulus situa- 


tinguished with 


box. Presumably, 


tions from acquisition to extinction 
would be more similar when the non- 
rewarded end box was present be- 
cause these stimuli had always in the 
past accompanied nonrewards. Us- 
ing the rewarded end box d iring ex- 
tinction would bring about a stimulus 
change because these stimuli had al- 

Che pre- 
; 


dicted results occurred, and were in- 


ways accompanied rewards 


uwccording to the discrim- 
authors tended 


to speak as if the discrimination were 


terpreted 

ition theory I ine 
perceptual in some fashion, but, of 
course, all they could do was to relate 
behavior to this 


stimuli, in case 


stimulus change. There is no need to 
introduce an intervening perceptual 
process to handle this data 

Monkeys were given their choice, 
by Elam and Tyler (1958), between 
two stimuli, A and B. For one group, 
the A was rewarded 60% 
of the and the B stimulus was 
rewarded 40° of the time. For the 
the A was 
OU", ol 
the B stimulus was rewarded 0% of 
the extinction, the A 
stimulus was the 
stimulus re- 
the both 
Results showed that during 


stimulus 
time 
stimulus 


, 
second 


group, 
ilso rewarded the time but 
time. During 
rewarded 0°, of 
and the B 
100%, of 


time was 


warded time tor 


groups 
acquisition, A was much more pre- 
ferred by the second group, but dur- 
ing extinction, A extinguished much 
more rapidly for the second group. 
Elam and Tyler attribute the much 
faster extinction of A for the second 
group to the greater stimulus change 
irom acquisition to extinction oc- 
curring for this group than the other. 
Pettigrew (1956) 


Goodnow and 





18 DONALD J. LEWIS 


presented a somewhat similar prob- 
The 
apparatus was a “‘two-armed bandit” 
One group received reward for a LR 


lem to four groups of human Ss 


(left-right) pattern of responses, the 
second received reward for an LL pat- 
tern, a third was given an LLR pat- 
tern, and the fourth was given a ran- 
lom pattern After an 
series of trials, all groups were given a 
random pattern for a while and then 
all groups were switched to a final 
LR pattern. Both the initial LR and 
LL groups learned the fina! pattern 
faster than the random group 
(Many of the LLR group did not 
Goodnow 
that the 


more dis- 


acquisition 


learn the initial pattern.) 
and Pettigrew 
final pattern 

criminable because of the stability of 
the pattern Also, 
there was less of a stimulus change 
initially 
e initially random 


concluded 
was made 


initial response 


for the two systematx 

groups than for t 

group 
McClelland McGown (1953 


gave one group of animals irregular 


and 


reinforcement in various parts of a 
Another 
reintorce- 
Results 
inconsistently re- 


circular shaped apparatus 
found the 
the same place 
that the 
warded group was more resistant to 


group always 
ment in 
showed 
extinction The authors concluded 
“Omission of reinforcement changes 
the cue pattern less if the original 
cue pattern is complex or variable, 
than if it is simple and invariant 
Shefhleld and Temmer (1950) have 
shown that the superior resistance to 
extinction of avoidance learning to 
escape learning can be given a partial 
reinforcement interpretation. Jones 
(1953) found that an “intermittent 
escape’’ group, that 
punished on every trial but still could 


one was not 


not learn to avoid, was more resistant 
to extinction than an orthodox escape 


group. Also a “limited avoidance’ 


group extinguished slower than the 
escape group. “Limited avoidance"’ 
referred to a condition in which the 
S was placed on an initially un- 
charged grid, but the current would 
be turned on before S could get off 
the grid 

shock he 
sense it was an avoidance condition, 
the 


avoid- 


The faster S moved the less 


would take, and in this 
but even so, S would always get 
Che 
ance’ group was also more resistant 
than the 


acquisition 


punishment “limited 
to extinction 
group The 
according to Jones, were more like 


pure escape 


conditions, 


the extinction conditions for the ‘‘in 
ind the “limited 


thar 


termittent escape” 
avoidance” conditions they 
were for the esx ape conditions 

In several studies Lewis and Dun 
can (1956a, 1956b, 1957, 1958a, 
1958b) found that 0% re 
ment showed tance to ex- 
than 
than 


reiniorcement 


niorce 

more resis 
or 

100% 


most 


tinction reintorcement, 


and more other percent 


ages ol Their situa 
“one-armed bandit differed 
that irning 
was involved in the performance of 


the lever pulling response. All Ss, on 


tion, a 


from most others in no le 


coming into the experimental room, 
knew to pull a 
[he experimenters ; 
that the 
primarily 


already how lever 
rgued, therefore, 
acquisition § series served 
to set the extinction series 
apart, and that 0% acquisition was 
most like the extinction series. In one 
of these studies (1958a found 


resuits 


they 


contrary to most previous 
that extinction was quicker alter a 
long acquisition series Again they 
attributed this to the pure perform 
ance situation in which a relatively 
long acquisition series would serve to 
make the initial 
more stable 

Somewhat 


reported by ‘¢ 


stimulus situation 


nave 


1957, 


similar results 


ipaldi 


been 
1958 
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Brand, Woods, and Sakoda (1957) 
in a two alternative situation varied 
both the difference in percentage of 
ind the difference in 
the ratio of reinforcement. The dif- 
ference, for example, between 57% 
50%, the ratio is 
three to one. The difference between 
100°, and 50% 


reinforcement 


ind 25%, is and 
is also 50°, but now 
They found 
that extinction is quicker when the 


the ratio is two to one 


percentage difference is great (a find- 
discrimination 
the ratios had 


with a 
but that 
practi illy no effect 

Febrer (1956), who found that de 


ing in a line 


hypothesis 


lay of reinforcement leads to in- 


creased resistance to e<tinction, also 
interprets her study according to a 
discrimination theory in that having 
ry come before a reward affords 
that of 


much like the initial experience dur- 


a de 
an experience no reward 
ng extinction 

All of 


reviewed in this section so far present 


the studies that have been 
evidence that has been interpreted as 


favorable to discrimination theory 


There are two recent studies, how- 
that 
hurdle for discrimination 
jump. Marx (1958 


of animals 


‘ onsiderable 
theory to 


ever, present a 
gave two groups 
acquisition training in a 
runway with food pellets presented 
During 
extinction one group was presented 


in the end box ina glass cup 


with the empty cup on every trial, 
und one group was presented with the 
empty cup on only half of the trials; 
on the other half the food cup was 
absent. There was a greater stimulus 
change for the group that had the 
cup on only half of the trials, yet this 


group extinguished slowest. In a 
Brown 
ind Bass (1958) varied the stimulus 
in both 

They 
found that variable extinction condl- 


more elaborate experiment, 


conditions—different alleys 


acquisition and extinction 


tions resulted in increased resistance 
to extinction. In both of these experi- 
ments, stimulus change increased re- 
sistance to extinction instead of de- 
creasing it as the discrimination hy- 
pothesis would seem to demand, but, 
it should be noted, only 100% rein- 
forcement was used in both studies. 

In addition, Brown and Bass found 
that 
during acquisitior 


stimulus conditions 


had 


resistance to extinction 


irregular 
no effect on 
This seems 
to run counter to previous evidence 
MacKintosh, 1955), but Brown and 
Bass have the better designed study 
in that theirs factorial 
bination of variables in both acquisi- 
MacKintosh 


under 


was a com- 


and extinction 


tion 
extinguished all Ss constant 
making it impossible, as 
Bass 
tinguish between learning condition 
irregularities and the change from ir- 
acquisition to constant ex- 
tinction. Both the Brown and Bass 
and the Marx study consistent 
with much previous evidence (e.g., 
Glazer, 1958) indicating that stimu- 


< onditions 


Brown and point out, to dis- 


regular 


are 


lus novelty and change increases per- 
formance. It seems, then, that one 
must at least conclude that stimulus 
change during extinction must be 
weighed more heavily in increasing 
extinction than con- 
from 
any 
case, the studies of Brown and Bass, 
(1958) and Marx (1958) complicate 
the task of discrimination theorists. 

Secondary reinforcement. Denny 
(1946) is usually given credit for the 
formal introduction of the secondary 
reinforcement hypothesis into the 
area of partial reinforcement. He 
pointed out that on reinforcement 
trials the stimuli of the goal box are 
associated with primary reinforce- 
ment and therefore should acquire 


secondary reinforcing power. On 


resistance to 
stancy of stimulus conditions 


acquisition to extinction. In 
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nonreinforced 


tinction, 


should be taking place which would 


retard 
The att 
iorcement 


195 i 
man 

extingt 
had 
the 


given in 


they 
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showed 
guished 
present { 
cordi gto 
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she uld h ive 


lhe stin 
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should 
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I 1957 
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100°, of 
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the 50% re 
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ondary 
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the time e 


two situation 
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trials and during ex 


secondary reinforcement 


ick oF 
hy 
Fedders« 

Tyler 

They found 


the goal box 


the se ondary reir 


pothesis began with 


Ivler 


that 
which 


rats 


their reinforced 


1 tr 


received 


niorce ils were 


nt goal box 


ced ils 
1943) secondary 


I the results 


pothes ~ 


ees the opposite 
ng extincti 
nged extinctior 
slightly differ 

1951) and 

the 


ispec 


t 


groups, 
ipport a 


‘ ' 
é re 
pr 


S7 } 
j 


195 


S's preferen: 
the re 
the 


rew irded 


constituted 
Most Ss chose 
id beer 
ven 


when twice 


ils had been to 


yiven 


warded stimuli. so th it the 
total nur ber ot 


rew irds in 


but 


primary 


Ss was the same 


50% group would have had sec- 


iddition 


were interpreted is 


. LEWIS 


opposed toa sec ond iry re 
hy pothesis 


Che 


, . 
iiso be i 


of Fehrer 


ter preted 


results 1956 


is Oppose 
niorcernye t 


part il rei 


secondary re 
ot 


her ¢ 


tion 


ot 


lorce 


” Ips 


wher 
7 " 


lew al 


mer; 
ver\ 
ited 


ibsolute = cé 


before 


~ probable that 
ilarly associated w 

t and then used irre 
a, ¢ have very 


At this point 
ies difficult 


pow ert 
ing value 
be oT 


tween 1 discriminati 





PARTIAL 


ind a secondary reinforcement one. 
It seems likely, 
basi ally 

Com peling 
1954 


tion” 


in fact, that they are 
the same 

Weirstock 
“habitua- 
theory which states essentially 
“ha 


ré sponse 

has presented an 
that nonreit forced responses 
uate” by some unspecified process 
For 


ill rewarded Ss, 


ind drop out a group of par 


competing re 


made during acquisition 


ponses are 


the nonreinforced trials, and 
the he competi x respo ses drop out 


Thus the 


already 


wher extinction begins, 
have 


1 and the instrumental re 


ny responses 


| ies strongly No ha- 
the « 


ompeting responses 
ng acquisition for the con 
reinforced group, and their 
ing extinction results in a 
in the instrumental 
experiments aimed di 
testing this 
vler (1956 
that Wein 
why random fei 
PRI 


nent are 


notion—al- 
has pointed 
stock's theory does not 
torcement 
alter- 


those of 


i wreater thar 
and 
( lavton 
if Ss were delayed in 


( layton 1955 
Stanley and 


box 


more competing re- 
ild occur and thus habitu- 

Thev gave immediate reinforce 

ment and i 30 -sec delay to two 
ng acquisition and broke 


factorially to 


groups dur 


these two down im- 


goal box removal and a 30 
The 


not 


extinction 
group 


resistant to extinction than the 


during 
tion delay was 
more 
immediately rewarded group These 
opposed to Weinstock’'s 


theory, 


results are 
habituatior if habituation is 

of time in the goal box, 
ire also opposed to the re- 
(1956 found 


Fehrer who 


REINFORCEMENT 


delays, both before and 
retarded 


30-sec 


the 


that 
alter reinforcement, 
extinction 

In another study, Hulse and Stan- 
ley (1956 
what 
(1954 


px ting 


presented a theory some- 
that of Weinstock 
They also argued that com- 
the 
nonreinforced acquisition trials, but 


similar to 


responses occur during 
for them the competing responses do 


“habituate The Ss learn to do 


not 
during 
starts, 
the 
learned 


other than eat 
W hen 


the partially reinforced Ss do 
that 


something 


these trials extinction 


‘something else” they 
during acquisition and are quickly 
the stimuli which 
thus the 
response 1s protected 
from rapid extinction. At this point 
Hulse and Stanley follow the notion 
of Sheffield, Roby, and Campbell 
1954), that the faster extinction of 
conditioned eating faster 
loss of 
This is because the conditioned eat- 


bar kward 


and constitutes an 


removed from 


evoke eating, al l condi- 


tioned eating 


leads to a 
the instrumental response. 


ing response works over 
the maze stimuli 
important part of the stimulus situa- 
tion leading to the instrumental re- 
sponse 

Hulse ap- 
pears to be more specifi than Wein- 
stax k's 
such a vague term as “habituation” 
play XZ in rol Also 
Hulse and Stanley indicate the 
goal box competing response can af- 
lect the be- 
apparatus. But this 
into difficulty when 
Freides’ (1957) data are considered. 
He found that 
box 
tinguish 


and Stanley's theory 


because it does not contain 
important 
how 
behavior occurring at 
ginning of the 
notion, too, runs 
yehavior in the goal 
food ex- 
runway response 


approaching could 
while 
remained 


Mediational response It 


strong 

should 
be noted that the theory of Hulse and 
Stanley (1956) involved a mediating 
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conditioned eating response and 


could very properly be considered in 
section ilso 


Wilson, Weiss, 
\mse! 


this 
ind Amsel 1955 
1958) have argued for a 


tration response as an 


PRI 
reintorcemert i er 
develops the 
forced tr The em 
sponse works backward over the 


maze stimu! the 


the During 
partial 
response 
] 
ils 
1s evoked bi 
stimuli DOX 
tional 
ties, as ‘ 
h t 
? 


strume i 


ecOoOiTe 


stimu 
il res] 
conditioned 

the 
100° 


emotior 


instr 
Ss. 


Spor! 


Siu} 
! 


which rein 


~t 


ystre 


lores 


tlorcement t oc 


during 100 itio because 


reiniorcemert! every tire is 


is S er hey 


goal box. 1 


soon 


do, 


; 


however during extine 


ol evokin mediating re 
Spor 


| d qui k extinctio 
With longer delays of rei 
during acquisition 
lelay procedure, the 


se al results 
lorcement 
such as occur in 


occur©r- 
to 


1 varied 


re of mediating responses 
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time cues will be 


postreintforcement 
increased because the mediating re- 
forced alter 


is eventually reit 


Thus 


sponse 
the delay. the mediat yw re 


1 
over a ionget 


Ss. al 


sponse continues time 


the 


rewarded 


lor partial delay 
ior being prolongs ! 


ir over a longer 
) Bex sus the 
| a 


ner 
! 


lasts longer 


presumabl 


respons 


bro ight 
by Humphreys 
sidered that his ear 


! 


regul cy 
Duncar 
Hun 
Ss state 

they 


lose ( 


il d 
test 
their 


Lewis 


tempted to ph 


by 
trial, 
they would 
trial They 
their d ita 

that 
cies of winning would contir 
than 


having 
the confidence 
win 

found 
Humphrey's 


irregular 


or 
no ¢ 
lor 


those with exper 


lev 
ue iO 


during extinction those 
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reguiar expectancies Insofar as 


Humphreys meant some over-all 


kind of expectancy, these data are 


ot pertinent since they trial-by 


are 


trial 
The 


has bee a 5 


expectancies 

Humphreys board 
} 
: 


two light 


ind ir 


t apparatus tor 
i expectancies “ves” and 


itements—for a number of 


‘cently several studies have 


ippeared with this device which have 

mulus presentation 
order to respond 
probabilities, 


} pre- 
the 


~wonses tt. pre 


must extinguish 
is to aflord a 
of study 
extinctior 
ith a two 
gave separate 


probab ties 
Lhe 


the 
as greatest 


sults according 


heory and coun 
‘ys regularity of 


He 


ev icle nce 18 


ex- 
' 
ais®) con 


iiVSIS 


ough the not 


m th 


Dermanence ot 


that the ex 
shift 


rie m 


$ pol 
was more 
ignitude of 
(,o0d now and colleagues 
Petti 
Pettigrew 
1955 

hy 
that ¢ would be 
to approach 100°% to the 
} the 


light al 
one than if it 


her 
1955; Goodnow & 
1955: Goodnow & 
(,000c now & 


u ber ol at 


roodnow 


Postman, 
udies have 
sized 


[eSscs 


obable situation 


were 1 “cha ce” were 


i ‘problem solving” one. James and 


er (1958) also hypothesized that 


“skill” 


difference 


chance and 


ike 1 


the situations 


would m to resist- 


23 


to 


‘nstructions 


ance extinction They gave one 
that 


the task involved chance only, and 


set of to indicate 
one set to indicate that the task was 


skill 


bined fac 


Instructions 


torially 


only were com- 
with 50 and 100% 
Their hypothesis was 
With skill 
o group took longer to ex- 
With 
chance instructions, just the reverse 
Rotter inter- 
the effects of 


kind, 


Postman 


reintorcement 
confirmed 
the 100° 
tinguish than the 50% 


instructions, 
group 
true | umes and 


was 


pret their results as 


svmbolix processes ol some 


and 


aifferent 


(,00d ne W 
slightly 


maintain that 


whereas 
1955), in a situa- 
“awareness” is 
' 


not a necessary part of su h proba- 
bility 


aiscriminations, 

Perhaps every study cited in this 
could be 
g to 


at that is 


report reinterpreted ac- 


expectancy notion, 


ain weakness of 


such a point ol view There seems to 


/ 


be oO way ot disprov ng it \ er- 


mud h research has 


ited 


tainly not recent 


been orie around expectancies, 


ind this concept is apparently mori- 


ition of the PRE 


bund as an expla: 
( ONCLUSION 


this review of 


The 


literature on 


writer be gan 


partial reinforce- 
nent in the hope of arriving at some 


the PRI { 


lar 


explanation of nior- 
ly, he away 
from an explanation now as when he 


tunate is at least as 


started Conflicts and contradic- 


tions in data contribute their share 


of confusion, but probably more im- 
portant has been the absence of the 
right kind of data 

this 
to 


Except in 


In the data sec- 


tion ol paper an attempt was 
laws. 
few this 
Not experi- 


ienters seem to be interested in how 


made discover parametric 


very instances, 


was impossible many 


one variable relates to another along 


the major range of both variables. 
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Most experimenters are interested in 


“theory” testing As a result we 
have a large number of two or three 
group 
different 
times combined in factorial designs, 
that 
tions are largely inadequate, but not 


lo de- 


probably 


experiments, using a widely 


array ol apparatus, some- 


telling us our theoretical no- 
telling us a great deal more 
termine a parametric law 
at least five points are needed alot M 


each dimension. W 


points, the task of stating the law 


th fewer than five 


describing it by an equation—is rela 


With 


number ot con 


tively trivial hve or more 


and a sma 
the dimet l } in be de- 


points 
stants, 


scribed with some recision, 


assum 


ing the data iable and that a 


dimension is 
arbi 


tainly curve tin ! * an 


trary procedure, and certainly it is 
not all but 
certainly, a theory ought to be about 

data 
matter 


there is to theory, also 


something, and 
make 
But 


elaborate 


parametric 
a wondertul subject 
this is 


way, 


just Saying, in a more 


more research is 
needed - 

Che writer feels no desire at pres 
the 
! 


aoes 


ent to carry cudgels for any of 


theories’ now available, no}. 


he have a theory of his own to cor 

tribute that he has any confidence in, 
nor does he think it sporting to take 
further ' pot shots’’ at the existing 


theories. The writer remains almost 


as empty of an understanding of 
when 
but 


he still considers the problems in the 


partial reinforcement now as 


to review the literature 


he beg in 


area to be fascinating 
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plometry, University of California, Berkeley 


me hears the cry ntr as simpl us black-and-white 
t has been dis mw made in Polaroid cameras.’ 
lications, however, could be much 

of visual science re widespread and commer ially important 
ide is indicated ides motion pictures a d television, which 
les ire closely related to ¢t present projection 


f the arti 
of a similar system 


‘A Bombshell in > tests 
fe reflectior nt n simplify color 
An Astonishing — agi | at 
; paper 1959 
New Light 
id's discoveries 


pplied to color photog- 
little questior that 
lead to new 
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Eediso will make 


The claims 


him and for 


iclumsy 


oveltie ~ 


KS, 


noted that none of the 
s 1s ittributed to 
color t " uw 
. . ! ia himself has said in 
WM) 4 . ‘ 
” yeal . ~ prit or nservative. The whole 


‘ 


of his material was 


planned for the Procee img of the 


National Academy of Sciences. Only 


Parts I and II have so far appeared 
Land: 1959a, 1959b), but they are 
perfectly dignified. His Sctentific 


t 2 
. ’ imerican artic le | and, 195% is In 


| te ; rit 
nave ; 4 more popular vein, but Land savs 


that wherever it is more excited or 
scems to aim more than his other 
wo articles this represe! ts editorial 
change over which he had no control. 
He did not even know that the paper 
Cros (1959) was in preparation, 
id he laims responsibility for 
the extravagant article ol Bello 
1959 


The st 


r material for the 
ikes no use ol the 
ciples Land thinks his pro- 


have uncovered G.L.W 
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Land did begin to consider the pos- 
sibility of devising a quick process for 
the Polaroid camera which would yield 
a print in color in a single while-you- 
wait operation. To begin to inform 
himself at firsthand of the problems 
that Land 
up, in orthodox 


would be involved, set 
three 


color-separation transparencies which 


projectors, 


had been prepared photographically 


through conventional red, 
blue 


Screened in registry 


green, 
filters 
through similar 


and gelatine ‘‘taking”’ 
filters, the imayes built up additively 
full-color reprod iction of the orig 
inal camera scene 
While trying various filters, beam 
and ol Land 
pened to that the 
hltered projector was turned off there 
i little 


of the reproduction on the 


intensities, hap 


note when blue- 


was only deterioration of the 
quality 


screen. Ina further “accident,”’ Land 


oved the filt 


rhe 


made 


er from the green pro 
intensified white light 
the 
But 
Meroé Morse 


; 
‘ 


picture quite un 
satistactory Land's collabora 
trix who for a decade 
noticed 


still 


Ss right 


there 


has been Lan irm 


that on the scree were 
traces of hues which seemingly should 


not have been there At the mo 
ssed as a “‘fa 

mage) effect. Late that 
however | ind returt ed to the 
and the 
projector “Instantly, the scene 


Bello, 


b irst 
indefinitely 


} 
I 
this was dism 


dimmed down white 


hi 
t ip 


into lifelike color” 


and 


long observation the color array per 


1959 with 


since 


sisted, it was clearly no afterimage 


phenomenon 


From then on Land's copy, whether 


still life or animate, was regularl: 


photographed through only two 


filters. A positive transparency n d 
black-and-white negative 
red filter (passing 


the longer wave lengths 


from a 
taken through a 
only 


con 


WALLS 


stituted a “long record” and was 


ordinarily projected through a red 
filter A 
made through a broad-band 
filter black-and-white 
positive record’’ of the 


| his 


considering 


negative simultaneously 
green 
provided a 
“short 
rather a 

what 
energies would have come through a 
blue taking filter 
jector, in which it was placed, usually 


( py 
res ord, 


was medium 


wave lengths and 


The second pro 


had no filter over its fron ns 


Anv object in the original 


was now represented on the screen 


by a patch of red | 
through a neutral area ol 


lar density in the long record 


congruent pate h of white | yl 


through an shaped 
irea of the short record, h 


identically 
sized 
higher 
The 
was a particular t 


and 


except by chance a 


lower neutral density 
“object” 
sum of red 
nances 

An el iborate 


iust such objec ts - 


picture 
should 
sented them all as reds, pint 


and blacks, depending ] 
hes 
i¢ Sit 


tive ind absolute ( 


correspon i ng pat hes. ol 
and short-record transparet 
red 


the dark-surrounded 3° he 


mixtures of and whi 
in instrument as 
could not vield or 
blue, or purple. La: 
did 
over, in 


th at 1s, 


show all these hues 

orrect hierarch 
warm colored obj 
copy were rendered bi 

’ 
same Warm coiors on the 
! 
Coo -« olored objec ts were re pre “4 


by cool colors in the Skin 
looked 
than in 


( hrome 


pr ture 
tact 
many Ektachrome and Koda 


like skin in more so 


pictures 


To Land's mind, here was a great 


mystery Where were all the extra 
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beyond those 
mix to 
theory 


“classi- 


from, 
lights could 


colors « oming 
his projection 
give, when classical color 
could not explain them? By 
cal color theory" Land does not mean 
isolated color-vision theory (Young- 
Helmholtzian, Heringian, or other), 
but this together with the relations of 
hues to wave lengths in the white- 
light spectrum, Grassmann's laws of 
color mixture, and particularly the 
fact that to obtain all hues and white, 
primary lights are 


three additive 


considered to be necessary and sul- 
hicient 


If the light coming to the eye from 


a patch of screen was seen as having 


a color which a colorimetrist would 


not expect to see in a mixture ol 
those two lights at those intensities, 
then classical color theory was inade- 
quate and outmoded Some entirely 
new theory had to be developed to 
account for all the unexpected colors 
which one obtained by two-light, 
one-color projection on a screen (and 
no other way) 
May 1955 
public 
The 
the 
again in 1957 


Land 


soentitc 


perhaps i! 
Land gave 
lectures with 
then 
laboratory, to 

In that year 


Quite soon 
bd 
the 
demonstrations 


went back 


first of his 
matter 
into 
emerge 
nd the next, made presenta- 
meetings 
Washing 


Harvard, 
in which 


to various 
universit\ 
Detre ? 


groups, at 
ton, Ro« hester, 


ind Columbia The order 
the phenomena came to be shown 
was as outlined in Land's first pub- 
1959a where they 


lication are 


described as numbered experiments. 
these 


either the red 


In an orderly way experi 
ments bring out that 
picture or the white picture is mono- 
tone or achromatic, but the registry 
of both makes a 
ference since full color then appears; 
the full 


instantly when a flood of room light, 


tremendous dif 


picture reappears in color 


which has washed out the screen 
image, is turned off; enough room 
illumination can be permitted to en- 
able the perception of colors apart 
from ‘the screen, and will not inter- 
fere with the colors on the screen; 
changing the subtense of an “‘object”’ 
at the observer's eye does not change 
its color; interchanging the long and 
short records turns red hair and lips 
greenish or blue-green, showing that 
the colors are not memory colors nor 
expectation colors; the hues seen are 
not much changed by large altera- 
tions of beam intensity ratios nor by 
doubling the contrasts in the short 
record with superposed duplicates; 
only red, pinks, and white are seen 
if the long-record slide is removed 
from the 
though 
still there; and so on 


red-filtered projector al- 


many intensity ratios are 
Land's oral presentations in East- 
ern cities never came strongly to the 
awareness of us who stay on the West 
Coast. I first learned of his projec- 
tion color phenomena when a col- 
travels much 
Land, 1959a) 


assurance 


league, who more, 
pressed Part | upon 
me with that 


this was the most important develop- 


the solemn 


ment in color vision in the past 50 
I read it and forgot it, for I 
that 
“simultaneous color contrast” 


years 
could not see anything more 
than 
was involved in Land's securing of 
hues from red to blue-green when his 
projection lights were red and green, 
or red and tungsten ‘‘white."” Much 
later, Land's popular article (Land, 
1959c) was forced upon me, when | 
was requested to deal with it as a sec- 
tion editor for a condensation jour- 
nal By Part II (Land, 
1959b) had appeared, as also the arti- 
cles in Fortune, Gr phi Arts Monthly, 
Architectural Forum (Anon., 
which were stirring up great 


and wonderment among 


this time 


and 
1959 
excitement 
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all sorts of both scientific and non- 


scientific people.? 


In 


makes about 


ind 
1 dozen serious claims 
be dealt 

the 


print and in person, L; 
with in either 
ot 


ones 


| hey cannot 
the 


their 


, 
airect of reverse order 


“importance,” for lesser 


have to be explained before greater 


weciated and vice 
be taken up here, 


or 


in be 
The, 


therefore, 


ones { apy 


versa will 


in more less an order 


First, however, 
the 


of comprehensibility 
to 


of novelty 


be considered 
ot tact 
ikes a claim 
of the rich 
results of his simple means 
1957 he learned 

the first to find 


there is jues- 
tion 

Land no longer n is 
vis- 
In 
that he was by 
that 


transparencies 


irds the novelty 


no means two 


color separation are 

1s good 
they 
much more 

His latest 
hint 
ot 
in his first 


more than two-thirds 


three, ind that 


much 


when are 


as 
added, one color filter is 
than half 
irticle (Land, 
that he knew 


the edi 


rood two 


is 
195% 


is 
vives no 


this perhaps, one 
but 
footnote ad- 
1914, motion 


! 


ted 


tor's dow gs 
ind, 1959a) a 
As early 


were 


paper L 
mitted it 


is 


picture systems pate! in 
| 

taken 

or 


ind 


were 


no hiter 


Irames 
red filter and 
-d and 


projected through 


which alternate 


through a 


through re green filters, 


red 


Statement 
literature 
‘persor communicati 


i 
transmitted during my visit to hi 


the « ategory of 


laboratory 


; 
i 


WALLS 


ones or through 
with none 


These 


which 


systems, and various others 
but 


the ut 


two-dve 
aiff 


primary 


used no filters, 


films which dodged eat 
culties of making three-dye 
ts so long 


the 


films, gave excellent resul 
cameraman could dictate 


Pure bl 


there 


as the 


colors of the copy ies had to 
but 


outdoor I 


lew 
that 


the 


be foregone: ire s 


such colors in iture 


easil\ ivoided, i! | 
ol 


satistactory 


they were 


color tion 


If 


roux 


reproduc 
flesh tones, 1 
1 the 
thing else was good enough 


tually 


faithfulness 
was 


skin col 


ors 


were 


seemed i waste to 


color process lor a wester! 
ndoor stories wher 


even tor 1 


ture and costume colors co 


lected to avoid those whi 


come out wrong 
Even Land's own favorite 
still 


for pictures is no 
memorable Optical Soci 
in New York on March 
wit! demonstratior 
Evans of I 
in one of which he projecte: 
short records taken throug! 
filters Land 


1} 
Veliow 


essed 


istman Kodak 


now 


filte 


uses 
and rs o1 


jectors. The hues or 


jotes 


cording to 1 
led 
purple 
Land has 


' 
Simuiafr 


inclus red. orat 


ot 
orites a redheas ¢ ! 
The 


closer, 


to one 


green sweater 


ould hare 
the n 


ind e 


be 


using red at 


lly 


ven when he is 


on one projector al 
this 


vellowish heht coming d rec tly 


from it white, the 


1s 


filament 
and 


still life copy 


a tungsten 
With 


elab« rate 


long short recor 


such 
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se mblages ol groceries w bric-a- 


brac, projected with red and green 


with red and_ yellow 


beams of 

white’) ones, it is clearly not the 
the screen whi h are novel, 
's explanations of them. 


only the 


results on 
but Land 
Land's full-color 


series of 


results are 

rediscoveries of 

phenomena—frst seen, in 

two-primary projected photographs, 
1897 

y to com- 

is just be 

is elaborate, 

goo photography, 

colors appear at all 

screen, Lat d calls a 

plete image, a 

The colors 

those of the projec 


1dditive mixtures 


year when the same 
mple isolated 
1s10! theories, 
laws, do not 
extra colors 
“cl he Wave 
just there. do 

‘n there 

hs changes 

not do so accord- 
f additive color 


of different wave 


themselves color- 
come trom 


col rs 


longer and shorter 


the entire scene, 
matter what 
are 80 long as 
are shorter. 


al d some 


onochromatic lights 


colorimeter muxtures 

Ng speci il case, and every 

Newton has been n isled by 
how colors arise in 

uations 

that it 

the 


is ™& anned 


to demonstrate 


color which is 


array 


If his screen 
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through a slender tube, only spots of 
red, pink, and white can be found; 
One can take 
the lighted 
view any- 
thing but hardly 
any objects will change color hardly 


all other colors vanish. 
the around 
room ofr and 


same tube 
outdoors, 
and everything, 
at all when seen thus. Land's screen 
pictures are most unnatural images. 

Now it is perfectly true that the 
wave lengths and energies at a screen 
the 


this does not 


locus do not determine color 
But 
that the color is independent of the 
that It is utterly de- 
pendent upon the light in the ‘‘ob- 
ject’ in relation to the light around 
the object 


seen there mean 


light at locus 


Even in situations much 
simpler physically, it is easy enough 


‘ 


vy of several 


| 
oO “ee a spot as having al 


hues 


when spot and surround: are 
constituted of nonselective materials 
illuminated by 
light 


tensities cre ated by 


and a single mono- 


The 


relative reflect- 


chromatu relative in- 
governing here, as shown 


1938) and by Judd (1940), 


inces are 
by Helson 
and expressed in Helson’s principle 


of “color conversion” with respect 


to adaptation ievels. In Land's ma- 


terial, one ratio-and-sum of two 
projection lights represents the ob- 
Other 
round it—if 


there would be no object, for there 


ratios-and-sums 
“other,” 


ject Sur- 


they were not 
would be no contour. 

In his kind of 
analyses, Land has paid much atten- 
tion to the ratio of the intensity of 
each kind of light in each object to 
the maximal of that 
light (at some place on the screen). 
He thus takes the 
relative intensity of each light in the 
the 
each 


own quantitative 


intensity same 


careful note of 


object, and of the intensities of 
object-lights relative to 
other He completely 
other and 
sities of the same two lights which are 


two 
neglects the 
inten- 


absolute relative 
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hitting the screen iround the ob cours “re? 1 squ 

ject’s contour There are spot-and paper laid upon a 
surround situations all over Land's colored paper. Here 
screen, and the color of any spot is non seems 

at the mercy of a different spectral plementary 


ra\ not 


composition in its surround unless’ the gray is 
the luminance of the spot is much though it becon 
higher than that of the surround. No of tissue is laid over 
wonder, ‘hen, that the color seen in cheek one tells 
any spot seems to be ‘ indepe ndent blurs 
of the physics of what is in the spot 
lo a_ colorimetrist, Lar 
prized phenomena would 
intolerable artifacts 
must be done t 
neutral surrou: 
matched by mixing in lored sur 
round of uncontrolled chromati 
the specification 
would be quite 

Che explanatio 
which Land obv 
vert, before he can expect our 

other exp! ination 


of simultaneous 


| iteral ac 
1943, 1948 


general 


as hei 


une X pee 


known, but } I F » I ol | i d's pictures 


Land’s «ituatior with their on photometer 
lio] 


concealed there ind which car gn 


niv whit 


brought out also in the simy lest spot oni lite surro 


and-surround situations One usu When such colors 
ally thinks of induction as it isshown the ry real-lookis 


of in an elementary laboratory even a black-and-white trar 
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their 
satura 


puts on a projection screen,’ 


vividness —-theu 


tion, if ft 


ipparent 


he term is allowable is tre 


I endous 
Whatever hue is induced into a 
ibly complementary to 


t, in the 


Spot 18 inevil 


whatever ligh surround, is 


loing tl lucing This is not to 


nig ne if 
iy, however, that the surround and 


be seen in CcoMm- 


In Land's px 


cCessar®riy 


which 
him to 


the case 
fluenced 

explanation In 
plementariness 


Cott 


the sense of muxture 


paired lights 


irticular intensi 
ise a white light 
a colored light 


Lhe 


of a lght and 


image 


ler-image comple 


the same in hue; 


nces, lor know! 
1938; Judd, 1940; 
nk, 1955 In 


a | hvysically chro 


not appeal 
( ylor secn if 
uxed from the direc 


7 
actually 


there and 

When 
xed from two beams 
both be colored or, 
and 


tend 


wh te, ; 
1 

Wii 
ice ol 
But 


i as il it 


seu ue 


iptation 


y lateral adapta 


irea subtending 


ty which images have 
4 textureless screen and 


1a plane 


as on a 


Iruly white light in the 
spot would now appear white-minus- 
But if the spot 
light is itself a liiile reddish, some of 


the spot. 
red, 1.e., blue-green 
redness can combine with 


little 


basis for 


its direct 
the induced and a 
of the 
neutrality, and the remaining direct 
and induced will 
make the purple. If on the 
other hand the spot light is yellowish, 


this kill the 


induced hue 


greenness 
blueness to give a 
blueness 


redne SS 


spot 


huedness 
the hybrid 
nd allow the spot to appear purely 


direct may 


bluene ss ol 
green. Furthermore, if a spot is sub- 
stantially brighter than its surround 
it can exhibit the hue of either pro- 
jection light or any additive mixture 
of the two, while in a spot much dim- 
induced black- 


navy 


mer than its surround 


ne can create maroon, blue, 
and other 
colors All ol 


bilities give way to others, with any 


olive, brown, “synthetic” 


suriace these possi- 
manipulation of the ratio and sum of 
the two kinds of | ght blended in the 
surround 

l ind's extra colors h ive a kinship, 
stronger than he admits, with colored 
Produced on a s 


filter or 


shadows reen with 


two projectors and a two, 


shadow colors ilways come in pairs,‘ 


which have interesting properties 
It both projection lights are colored 
but 


regardless olf 


not complementary, then quite 


colors 


their 


the hue of neither shadow 


what are, 
is ever the 


hue of either light since the surround 


aii colored shadow 5, 
t i owscape, may 
be exceptio al. When ob 
both 


blue is 


ippear to 
ects are illuminated 
1 white cloud-light, 

object blocks the 


sunlight from the snow. The unseen (adapted- 


yy vellow sunlight an 
seen wherever an 


out) yellow surrounding the shadow induces 
to the white light 


No yellow 


mate to the blue shadow is seen, because the 


complementary blueness i: 


which, alone, occupies *4e shadow 


huge white cloud source creates no shadows at 
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of each shadow is not purely either 
light. But, the hues of the shadows 
are invariably 
each other 


complementary to 
rhis fact has been known 
so long that its first discoverer is lost 

while its most 


recent investigator 


(H. Self, a student of Helson’s) has 
not yet published his work. If the 
light from one projector is truly 


white and the other light is hued 


say, green—we have a special case. 
The hue of one shadow will be that 
the 
white-plus-green can induce nothing 
that will alter it; the hue of the other 


shadew will be red-purple, induced 


Same green since surrounding 


into the white light in the shadow by 
the impure green light outside the 
shadow. Here, side by 
“purely physical’ 


side, are a 


(green) shadow 
“physiological-psychological”’ 
(magenta) one It 
note that both shadow colors can be 
highly and equally saturated while 
the rest of 


and a 
is important to 


the screen is acceptably 


white and necessarily brighter than 


either shadow—again Kirschmann's 
Laws to the contrary 

With Land-type long- and short 
record slides in red and white pro 


jectors, one has only to displace one 
slide to throw the two records out of 
registry on the screen. One then sees 
that the 
represented by a set of colored shad- 


“objects’’ in one slide are 
ows, not absolute but parti il to dif- 
ferent but all of the 


hue and differing only in saturation 


extents, same 


and lightness. The other slide is also 


putting up a set of shadows, of one 


other (and complementary) hue; and 


of course the two hues are salmon 


and aquamarine Upon pushing 
the displaced slide back into registry, 
that the 


created 


one can think—for a time 


additional colors are all 


simply by superimposing two com- 


plementary sets of colored shadows 
upon eat h other 
When Land 


claims to be getting 
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color, this is an exaggeration 


full 
in two respects The term implies a 
the 


ind does 


faithfulness of reproduction of 
copy colors greater tha: | 


get. It further implies that all possi 


ble hues are there, or obtainable, 
even if some objects have slightly 
wrong hues. The composition on the 
screen does exhibit many, many 
colors a color being a hue at a given 
saturation and a particular light 
ness If the observer penetrates the 


glamor of the multiplicity of satura 


tions and lightnesses cre 


iting t s 
and “shades,”’ and beautiful surface 
colors present by grace of induced 


, and resolutely hews to the 
finds that 


Nothing on the screen is 


blac kness 


hue circle, he there are 
gaps in it 


blue 


greenness, and nothing is green 


really without admixture of 
with 
out contamination with blueness 
Only in casual viewing can one think 
that some of the palest blue yreens 


of the darkest, green 


are bl je; some 


Land had considerable trouble mak 
ing a lemon look like a lemon with 
red and white projection—he told 
me that it took three months of trial 
and error with taking filter ex 


posures, and darkroom work 


What can be expect 1 from vari 
ous ratios-and-sums of red 1 yel 
low illuminations inside and itsicle 
of obiect contours?’ Re j p k ind 
white of course, with the whites being 
seen wherever sums are high and the 
ratio of the two lights is the same as 


their i teyrated ratio over the screet 
j 


establishing the observer's “white” 


idapt 


as his general chromati 


level it this sarne 


Wherever abo 
ratio occurs but with a lower ver 
low sum, there will be a gray or 
acceptable black I pset the ratio 
but keep the sum fairly high, and 
there can be oranges and yellows 
Thet ther will be blue-greens in 


duced by a strong red-light conte: 


ot surrounds, even whe these ire 
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adapted out and appear white, or ex 
hibit induction themselves. 
Some of the 


passing 


( ole rs 


blue-greens will be 


greener, for green; some 


bluer, passing for blue. There will be 
and 


surtace 


purples blackness-containing 


synthetic colors 
browns, drab, etc 
What What 
thunderstruck viewer of this marvel 
would think to ask whether anything 
in the copy had been sky-blue? Is 
it just a coincidence that Land's dem 
onstration have all 
made indoors, and show objects he 


tans, 
maroons, 


navy, 
more could one want? 


pictures been 


~ le« ted 
Now 


this 


for Land to say that none of 
is described, 


an ted bs * 


i bit 


explained, or pre- 
lassical theory” is to be 


harsh toward centuries olf 


x science and a legion of color 
As old as 
the 
low 
prior to 
They 


comp 


I 
scientists living and dead 
iny branch of color science is 
knowledge of 
satura 


induced hues—at 
to 


tric sources and projectors 


be sure, 


Ons, 
were being exploited in ,the design 
Thomas 
knows 


of Gobelin tapestries in 


Young's No 


how long ago mothers began to teach 


lifetime one 


their daughters what colors to avoid 
inh 
their 
“Accidental colors” 


its and scarves, so as not to affect 
facial complexions adversely 

were being mon- 
still 
irguing over whether three primaries 


sufficient in 


ographed when people were 


were necessary and 
ig and printing 


none 


paint 
pati 


It mav be that of Land's 
technological predecessors with two- 
beam. one-filter color systems, knew 


their systems worked so 
well It be that no one before 
Evans Land had the photo- 


graphic facilities, the filters, and the 


just why 
may 


and 


projectors with which to take such 


full advantage of induction to pro- 
duce such breath-takingly beautiful 
pictures with such saturations of the 


unexpected colors. But what needs 
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to be explained is the long list of 
hues that there and the short 
list of those that are not there, and 
this can be done without making use 
of any part of Land's explanation. 
One needs only old information and 
old language. In fact several! lan- 
guages are available: that of simul- 
taneous contrast, that of spatial in- 
Evans's three kinds of 
adaptation (1943, 1948), 
conver- 


are 


duction, 
chromat 
Helson’s principle of 
sion (1938, 1955 

Land explicitly denies that any 
adaptation is re- 
“The 
appear and 
do not alter appreciably with time, 


color 
and so on 
sort of chromati 
sponsible for his color arrays: 
colors immediately, 
and we do not seek to explain them as 
To the best of 
our knowledge the gamut of color is 
. predicted 


etiects ol idaptation. 


much larger than that 
by any theory concerning chromatic 
adaptation” (Land, 1959a). He 
formerly demonstrated the immedi- 
acy of appearance of the colors by 
turning on strong room lights which 
obliterated the and 
then switching them off to show that 
‘“‘no visible time lapse’’ occurs before 
A newer 


to 


screen image, 


the full-color effect is seen. 
which he demonstrated 
me, is a double shutter with which 
both beams of his dual projector can 
Even with 


device, 


be flashed to the screen 
a 0.01 sec 
there 


ol ly exposure, the colors 


are all Land considers that 
since inadequate time is being al- 
ior any 
adaptation cannot explain the colors 

Land's trouble here is that in any- 
he 
awareness of only the long, slow, in- 
sorts of adaptation which 
are regulated yy the 
kinetics of phetopigment-concentra- 
[he general and lateral 
tations which underly 


lowed adaptation process, 


thing has published, he show 
tensitive 


cold-molasses 


tion change 
chromatic ada 
contrast phenomena are instant upon 


presentation of the stimuli (which ts 
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why the contrast is called simultane gray in any discrete area 
ous ‘hey are more akin to the pens to contain that ratio 
alpha adaptation of Schouten and nore heterogeneous the 
Ornstein (1939) than to the photo- have been chromaticall) 
chemical beta adaptation, and the closely the observer's white 
are readily ac mp ished by the ex proac h the ratio com r Oo 
inhibitions in purely chro projectors il the slides are 
pathways, leaving dbrighines from them and the inte 
altered see Walls, 1955 already adjusted tor b 
nowledge has had the tude) are left untouche« 
to measure the A conviction of Lar 
takes for induced colors pregnant with several 
Since the basis of spatial nificance is that the 
not photo archical order of the co 
ied is tures, the 
is required ior a h obj 


the 


) traverse a couple 
under 
sO 
phenome: 
presentation when he be 
were cut below p nares fe 


the induction 


a photog: ipn 


white 


bac kgro I | there need 
broad tray luminated r 
formed by my scree Whatever 
two lights he is projecting with, the 
observer's ite will be some 


tensitive fra { the wo, whether 


one light is colorimetrically v OF ll-color gam 


I) 
even if both are colored nm any t { 


case the average ratio ow further 
screen will be what the obser 


adapts to, ind he will see white worlds of 
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paratus other than simple lantern- as it is in Kodachrome. At the same 


slide projectors, have served only to time, paradoxically, it is due to a 
entrench it in his mind coincidence. 

lhe fact that in Land's potpourri When Land assembles some ob- 

tures the right colors end up, for jects with hues ranging from red to 

rt, in the right objects is blue and photographs them through 

eem the more remark red and green filters, then projects 

msiders that all the with red and yellowish lights, the 

may also be ob long record of a red object is of low 

when the slides density and lets through intense red 

stemmed from ma light, while the short record is dense 

never was colored. One _ and lets through little of the other 

two montages of pieces light Naturally the red object is 


x 


itine filters cemented to rendered red A really green or blue 
} 


identical ex epting lat object is represented in the long 
, is replaced record by a dense area and in the 
nt piece ol short recor l by i p ile one The 


cot 


grue 
sity. Projected shorter-waved (or the “white’’) light 
same hiter(s Land predominates in the screen locus of 
se will yield the same __ the object. This light however must 
the screet ] ; ol necessity appear blue green or 
color’’ may even be green-blue his is not at all be- 
photogr iphs, when cause the origin il object had such a 
h character that there color, but because the stronger red 
0 expect any object to illumination around the object-area 
particular color. This the screen induces its comple- 
with “long” and “short” vent, and this happens to be an am- 
graphed through a dead iguous hue which satisfies the ob- 
fferent wave length reproduction of either a 
t or i blue one as the 

he 
It is a beautiful coincidence, at 
work for Land, that the complement 
of his red projection light is a blue- 
green, so close to blue and so very 
far from red in the spe tral series of 
hues. With selected copy the result 
s almost full color, and the hasty 
not be blamed for calling it full 
neutral montages, how is « f Only pure blue lies beyond 
that the hues are not random in the series one does get, for violet is 
I's pictures als What makes really a purple, the purples are extra- 
into place in the correct spectral anyway, and moreover 
ss Land is right in Land's method does afford some 
the eye itself puts purples! The reason why pure blue 
t is viewing a_ is not obtainable is not that blue 
Sadly for Land’s wave lengths coming from blue copy 
verisimilitude in his pigments are stopped by the green 
about as inevitable’ taking filter used to make the short 
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record; it is that the long-wave pro- 
jection light employed has a hybrid 
hue, not a good blue, as its comple- 
ment. The projection lights, not the 
the 
are the real determiners of the set of 
hues the can Land, 
however, thinks of them as the least 


copy colors nor taking filters, 


screen show 
important elements in the process, as 
we shall see 

If anyone should fail to grasp the 
fact that the full”’ 
Land's pictures and their fair veri- 
similitude 


‘nearly color of 


(excellent for 
colors; poorer ind poorer 
too bad 


the results of 


long wave 
but never 
for shorter-wave 
a beautiful and beauti- 
then I would ask 


Suppose the physiology of color vi 


ones are 
ty ing coin ider ce, 


sion were such that the complement 


vellow How good 


then would be the 


of red was, say, 
verisimilitude 

Land's idea that hue is, Or can be, 
1 his 


rich colora- 


independent of wave length, ar 
idea that the obtaini: g ol 


tion from two “primaries den 
completely new exp! ination, 
‘the eve 


colored wor! is of its 


to conclude that 
its own out of in 
formative materials that have always 
been supposed to be inherently drab 


When 


two Ki 


and colorle ss.” 
receiving only 


itt 


which are no differe: 


other 


very 
each the 
ible 
sign hue-sensations, which 

to the ends of the whol 
just those two lights 


system is 


app irently 


© spec 


' 
} 


vening hues to 
lights 
From a 


this is by 


biolog 
far the 
Land's ( lair s It see| 

found implications for the course « 
color 


evolution of human vision an 


for its physiology—it seems to 


mand a complete abandonment of 


such old-fashioned conceptions as a 
three or four 


set of receptor-types 


GORDON L 
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each arousing immutably a unique 


elementary hue-quality irrespective 
of the wave length(s) of radiation its 
unique | hotochemical contents are 
absorbing 

how 

} 


init 


In order to determine 


together two projection l 
and short records « 
little of the Newto 


m they 


inating long 


be, i.e., how 
could embr 


give his full color, Land first « 


templated using interference filter 


with much n 


urrower pass bands tha 


ones 


Too 1 


have ich 
lor 
al 
monochromato 


With this he « 


either 


would be sacrifice 


? 


closeness; so, Land had 


du il 


d built 


intensity 
signed a 
transillu: recor 


any wave ngth, Set 


izes in registry by mear 
halt-silvered 


| ; 


Variety ol 


mirror. 
now found that wi 


mone 


pairs of 
could secure fi 
has to be remembered 


th color” as 


uses the word 
h ic 


With w 


towe ther 


ave lengths 


the colors were 


d when the | 


the 


| 


irated, a 


irom ons of 


certain reg 


the gamut of hue itself was 


stricted Land has claime 
good result, however, ever 
two ww 


500 wv 


ive lengths were 57 
u. The color illustr 


by Sctentsfhe {mer 


Oc ir’ 
195% purp 


irs oO 


which 


what then app 


very hard to be weve 
not 
} 


monochromator 


parently still puzzles Land 
he has discussion 


Phis 


versal,” 


rromuised i 


is what he calls ‘‘short-w 


‘Vhen both of 
lluminating wave lengths are 


the very few hues he then gets 


the tr 

short 
ones, 
ire in the reverse of a correct order 


that is, the oolest colored copy ob 
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jects come out:in the least cool hues 
rhis corrects itself if he interchanges 
the records or the wave lengths so 
that a violet wave length illuminates 
the long record and a blue one the 

To my mind the reason for 
is that violet 


and blue does not, so that a violet 


short 
this has redness in it 
wave length acts like a longer one 
when it is paired with a blue 

The work with the dual 
chromator appeared to support the 
theory that 
of a short segment of the whole 300- 


mono- 


when only the extremes 


mu Newtonian spectrum are avail- 
ible to the exhibits 


ss 


and “can re 


retit the eve 


“amazing versatility’ 


spond with a full range of sensation” 


i.e., of hues), by reassigning all the 


hues that belong to a 300-my stretch 


to the wave lengths within a stretch 


if only 30 mu. Somewhere 


20 muy or 


such a short there is a 


po whi h, Lan ] believes, 


within range 
the eye 


Wave 


matter 


establishes as a 


“fulcrum.” 


gths longer than this, no 


t their values are, are 


think of as 


belonging to the longwave end of the 


absolute 


seen with hues which we 


full spectrum, while wave lengths 


the balance are 
they were really 


blue 


shorter than point 


responded to as if 


short (blue-green, even if they 


lie i midspectrun 


Out this reassignment theory 


corollary hypothesis which 


arose a 
I and 


195% 


has quite explicitly outlined 


Suppose the pigments of 
things around us had 
reflection-bands of wave lengths, so 
thatan 
be crowded into a short piece of the 


very narrow 


umber of such pigments could 


present visible spectrum, say 30 my 


or 40 


somethir ” 


Suppose also that 
the 
solar spectrum reaching the 


my long 

should happen to 
present 
earth's surface 
light 
the itmosphere so 


sare 30-40 my 


one might imagine 
ibsorbing materials getting into 
that that 


“spectrum” was 


only 


available to the retina. The colors of 
the things around us, Land believes, 
would be just the ones we see now. 
The reassignment phenomenon pre- 
pares us to be transported into any 
“color worlds.”’ 

The basic idea of a “fulcrum” is 


one of many 


not wholly wrong, provided one takes 
the position that it really expresses 
Land's own unconscious rediscovery 
of general chromatic adaptation. If 
shadows 
wave 
lengths and gets red and blue on the 


one projects pictures or 


with yellow and blue-green 
screen, the red sensation is not being 
“assigned to” the yellow wave length 
but is induced by the blue-green one, 
and the blue is not assigned to the 
the 


wave length would in- 


blue gree! bu 1S nduced by 
yellow. One 
deed appear here to be a fulcrum 

the dominant wave length of that 
Y-BG which, through gen- 
eral had be- 
But 


wave 


mixture 
chromati adaptatio" : 
come the observer's “‘white.”’ 
the lect this 
length out of what is coming into it, 
for it 


in either stimu- 


eye does not se 
ind use it in a particular way, 
need not be present 
lus 
With 
slide 
that 
light could serve as a “primary” just 


using 
found 


original method 
Land had 


unfiltered tungsten-) 


the 
projec tors, 
“white” 


is well as the purest of color-filtered 
Phe dual monox hromator con- 
white 


lights 


tained a pair of hinged sur- 
faces, each of which could be swung 
to occlude one of the 
and reflect the 
tungsten-lamp light 
through one slide to the 45° mirror 
and the This ar- 
rahgement enabled Land to confirm 


that when shortwave monochromatic 


into position 


diffraction gratings 
undispersed 


obser ver's eye 


light came through the short record 
and white light through the long, the 
picture contained reds as th h the 
white light were a long wave ljength. 
When white light was sent through 
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the short record and long-wave mon- 
ochromatic light through the long 
one, the picture exhibited blues as if 
the white light were a short wave 
length 
This led Land to pose the question, 
“what is the wave length which is 
equivalent to white, the wave length 
than which white is neither longer 
nor shorter?” Such wave length 
would be that which the eye employs 
the fulcrum in the ordinary, sun 
rid,’ with respect to which the 
iF Css Seti 


issigns a re 


to the lor gest other 
ivail ible and a blue ess 
to the shortest other w ive 


eye With 


; : 
light going through one reco 


ng Ww 


monochromatic light through 
, | 


the observer would find 


wave length as that one 


would have 


server as ic 


however 


ossib 


two lights in the surround 
The two odd observers 
found a rather 
fulcrum” w 
nave had unusual lens 


unusual luminosity 


WALLS 


curves, of 
had normal color vision 
myself with n 


them 


anon 


some such 


’ 


in Cambridge 


The du: 


pear that white 


made it ap 


give 


i sensation ot rec 


il monoct 


' 


color depending up 


chror 


lat 


light it 


be emed 


upon 


ough 


19 


what 
iwa 


59b. 


these th 


devise 


la 


he took a 
particular W 


: 


19 


lights 


mys 
and 
illun 
the 


té 


hirst 


ly 


light 


nis tw 


S9b. 195% 


red an 
the other 


through t 


long recoré 


| thro igh 


tf 


iro! 


vi 
he 
| 


i 


viewer, A589 


than the dominant w 


r 


gree 


>t 


sh 


rt record 


ive 


ling 


tor lel 


ow 


hI 


Both 


i ked 


Nagel 


aloscope, which | had with me 
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viewer, A589 shorter 


domi 


my 1s 
wave length of 
filter. 

groceries 


int 
long-record 
he picture of which 
Land presents with the green filter 
ontains ne objects partly or 
vivid red 


that 


wholly red, part ilar a 


il ol pepper | | 
the ASS9 my 


he pepper-« i ire 


assert 
here if is com 

1 
whicn 
the other 


er, where A589 is the 


yw the red sensa | 
shorter 
nulus. ‘ obiects ippear 
a blue-green 
nd claims 

af 


sensa 


iw” Wave 


Irie ind 


the thesis 


rious hues 


t itself is 


ng 

iamous 
the green fit 
the short re 


is represel 


it the sod 
red 
lhe 
is given 
that 
lf viewed this 
For 


slightly 


iving 
eas to be the can 
to what ally ng o 
dividual iriation 
red when I myse 


T a ( 


ne 7 
! 


imbridge 

was a 
ta | did not de 
kill al 
was there for me 
called the 
ind fourth 


yp pper cal 
i 1 Mmagel 
ugh vellowness to 


ness that 


person present 


A third 


purely red 
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called it orangeish-red—for them, 
re was more than enough yellow- 
or else less blueness in the hy 
induced by the 


What was varying here, 


brid 


green light 


complement 


of course, was the shape of one’s per- 


sonal curve of ‘“‘the intrinsic satura- 
tion of the spectrum os 
other “ to cle scT be 


the 


they are all in 


Thére are 


iys 
{ red 
old 


pposition 


he genesis ol pepper-can,; 


but languages, 
requiring no s that “‘the 
iled to be an instrument ol 


eye 18 reve 


unsuspected and sub 
tiety So far as | 
red of the pepper-can is being seen 
where the A589 my ts, but it 
the 


round that is putting the red there 


iwe-inspiring 


im concerned, the 


is the 
adapted-out green in can's sur- 
induce 
substi- 


would 
light 


just so its di 


he same t und 

into any other 
tuted for the A589 1 yu, 
rect color was low enough in satura- 
tion In the red-filtered 


viewer, it 1s jus is clear 


redness 


sodium 
that 


green-blue or blue-green seen in any 


any 
object is only the ex pec ted induction 
red 


h readily 


product ol re more intense 


light in the surround, wh 
direct vellowness of 


the least 
in the spectrum 


verwhelms the 
he A589 muy (vellow being 


tur ited lox us 
Land, believing strongly as he does 
his theory that color vision works 


hues to available 


Y assignment ol 
ive lengths s ply according as they 
ire longer or shorter, has been led toa 
evolution of 
Bello 
ye ol 


“Would 


1 system which had 


hilosophy about the 
I P} 


human color which 
1959 quote erectly 


Land's 1957 public iectures 


vision 
irom 
it be possible, ir 
only a pair of receptors balancing off 
against ear h other somehow, for the 
animal to have a sense of a full range 
red, 
yellow, green, down into blue? 


of hues running from orange, 
Phat 
animal could see the leopard in the 
leaves in a way that his competitors 


couldn't. He would survive the leop- 
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ard ...and go on to build the world these hue qualities, either singly or 
we live in.”” Elsewhere (1959c) Land in blends of two, can get into sensa 
has said: tions—courtesy of induction—when 


, only red and yellow (say) lights are 


we have not been descril ing a two-<« lor 


theory of vision... . It is true, however, that i™pinging upon the retina. But these 
our experiments deal with two packages of in lights, or any two others, or any one 
formation ... the eye ( Imo ry- light, activate all three components 


hing it needs to do « t mac 
thing — of the system In n earlier, two 


there is not a very 1 } 
, : the 


’ ’ 
filled 


component st ize ot system, no 


yne from the evolutionary more hue qualities than red, possi 


ol view Why has a system that ca bly bh it probably not vellow i! d 


work so well with two 


packages of informat green could have been e1 
evolved to work better with three : : oc 
Land (1959c) errs 
feel that the big jun p is bv siy fr 
to two (p. 99 the centr: 
ponent the 
Translated into la iwuage which the eve 
most color-vision researchers would kinds of 
use, this means that Land views the sensation 1s the res 
course of evolution | late col the three responses in 
ision thus: Originals ingle of strength.” He attributes th 
ceptor-type ly monotone Maxwell and Helmholtz, who 
or achromati i \ ym the stead believed that each rece 
/ 


difterenti ition ol th Ss in 5 . typ responds to some exte tt 


the system became able ive wave length in the visibl 


nsciousness the hu from re One has to go back to Thor 
bluish blue-green, some purples, neu for the short-lived idea 
trals surface colors (containing receptor ts activ ited 
blackness . lll by assigning the ex one bit of the spectrum 
tremes of the hue series to the vibr ifior il d respor 

available stimulat ' neighboring 

Essentially ; 

hue missing was purest blue 


is hard to see why the organisn 


on to rdd 50% more mechanisn i in , . ibout it he 


third receptor-type and all accessory mu : only two compon 


is one more ind 1 third might as well 


neurons 1ust to secure th 


hue for the sensory gamut; but this evolved—all the hues n 
did happen y an observer with a 
Ihe catch here is a double one lr nent system being the 
the first pl: 
prior to the invention of a blueness ince who did 


ce.a i point in evolution j have been 
receptor in the retina, the higher 
levels of the svstem would not have 
embodied mechanism for putting any 
blueness into any sensation, whether 


by induction or otherwise Man's 
present three-component system al y diff ! Des, 
fords redness, greenness, and vellow- re ynne of them 
ness synthesized from their bases, two hues in the entire 


together with blueness, and all of spectrum he color-nor 
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ences perhaps 40 hues.* Dichromati 
jump’ above mono- 
afford 
Even 


“a big 
chromatic, but it does 
10 pure blue 39 
though the color 


Vision 1s 
not 
hues 

iormal 


sees many 


colors in i Landian 
ector pr ture t} 


to be 


more two-pro- 
in the simple stimuli 
worth, this would not be 
for a dichromate. For him, any 
length to one side of a neutral 
the same 
that he 


m any wave length on 


in induce only one- 


other hue gets 
de of the neutral point 


and 


rected throug! 


short records 


pro 
red and yreen filters, 
a normal may see on the screen reds, 


oranges, yellows, chartreuse, greens, 
d neutrals \ 
would 
red 


Vari 


‘ 


purples, an 
ilongside 

ne kind of 
each at 

Oo Zero (\neu- 
Land's color re- 
called much 
it would be 
s all just a 
Land's 
ind the 
from it 
although 


extract 
salvageable 
1940 formulations might be 
the projected-color situ 
r more so It 
the hands of Lar 
‘m will enable a 


may well be 
id and others 
e syst 
und accurate predic- 
tion products which 
lave been had, or had 
it. This may be only 


wishful thinking, stimulated 


It is commonly 
ire about 120 discriminable 


1 guess 


brightness spectrum and 20 


irples There may be 120 


h is a ¢ 


rve ot 


ym plex of hue and 
AA os A” has never 
Muration spec- 
hue discrimination curve," 


determined an equal 
trum. It is nota 


but a wave length discrimination curve. 


by a considerable 
Land. I myself am not qualified to 
quantify anything complex 
than my bank balance. 


Land's coérdinates are Cartesian, 


sympathy for 


more 


but nothing else about them is con- 


rhe 


Ss ale of 


ventional ordinate axis is a 


logarithn “percentage 
available long wi velength stimulus” 
the 


st ale ol 


and abscissa axis bears a log 
available short 
With long and 
short records in projectors or in the 
two 
the 


screen finds a pl ice also as a point 


percentage 


wave length stimulus 


dual monochromator, and any 


projection lights, any point on 


on a graph with these codrdinates. 


When the 


lated fcr best color array, 


beams have been regu- 
the short- 
is cut off and the 


maximal intensity of the long record 


rec ord Hlumin int 


image is found and measured, with 
this luminance then taken as 100%. 
any other 
value for 
Abscissa values are found 


The relative intensity at 


locus gives an ordinate 
that locus 
in the isolated short-record image, as 
percentages of the highest intensity 
anywhere in the image. One point on 
the graph may, of course, represent 
any number of image points where 
the same absolute luminances of the 
two kinds of light happen to occur. 
These various physically identical 
exhibit the 


same color unless they all have identi- 


image loci should not 


but Land appears to 
claim that they do, since on a sample 


( al surrounds; 


graph, given in all three of his papers, 
he labels single points with single 
color names 

Each 
sents a relative intensity relative to 
another 
supposed to describe and predict a 
This has 


point on the graph repre- 


relative intensity, and is 
unique color on the screen 
helped to make it appear to Land 
that ‘“‘the eye turns brightness ratios 
Bello, 1959), although, 


as pointed out above, he considers 


into colors” 
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only ratios in spots and neglects 
’ 


ratios in surrounds and ratios of spot 


emphasizes that his coérdinates are 


ratios to surround ratios 
dimensionless, scaled in naked num- 
Actually, 


has to be 


bers since a new eg iph 


made for every pair ol 
ind for 


tor 


color-separation positives 


every pair of lights used ever\ 


the 


calibrated directly 


coérdinates could he 


picture, 
in log luminance 
they 


not, for the percentage scales do 


generalize or universalize 


It is hard for me to see why 
the gray 
he predictive values of ar 
graph are confined within itself, for 
that 


what « 


graph can tell nothing about 
olors will be seen, or where, in 
with other lights or 


liot 
Same lgnts 


that 


another picture 


even with the 
the 


the 


all of 
blacks or 
screen plotted along a 45° line 
coérdinate system This is 
the 45° line the 
ratio of the intensity of one light to 
the is 
Stant lf a 
" 


i ind 


Land soon noticed 


wWites, grays, and 


n his 


log al, 


lor of arithmeti 


tensity of the other is a con 
this 


itral, 


screen with 


point 
some sul appears ne 
other point with the same 


should 


ratio * one 


unother sum 
this 


would exist all 


ind 
linarily over 
screen if the slides should be re 
the apparatus Lan 


line the 


, , 
ine it 


noved from 
I! the 45 


the “gray 


‘neutral line” 


co ild as well 


called the neral chromati 


idaptatior 
Since 


plot 


line™’ “adapt itor 
colors 
45° 
1e readily sees 
that the 
a physical 


level.” warn 
the 


it, of 


neces 


Sari above line and 


cool colors below 
whence came Land's idea 
Newtonian spectrum is 

artifact of and and 
that the real 


irom 


prisms gratings 
visual scale of sensation 
runs warm hues through neu 
trality to cool hues. 

has to read with caution 


Land's description of the properties 


One 


WALLS 


sight lines other than the 45 


CoO ai late 


tracks” 
the or 


on on a graph in his 
He calls them 


and 


“achromatu 


includes among these 


ibscissa axes themselves 
has to know 
color he means nite 


that 


dinate and 


lust is one that when 


I ind 


also one has to ki ov 


SsAvVs 
whet he 


achromatic he 


SAVS 
matic-or-monotone—he 


bet weer 1 = 


distinction 


points wh h all have the 


1a set which all have 
short of full color 
SS a5 oO cok f 


mong these‘‘achroma 
the 


! rotated or 
placed (but still straight) gray 


line loci are 


which results {rom doubling the 
trast in one in 


la. 
maye 


ge (by ust 


ord trans} 


rs of short-re: parenc\ 


it right angles to the 


Such a 


d a line 


lit c 


gray 


us of all that one can ge 


, 


screen by projet ing at 
with a 
This is not 


‘achromati 


in registry positive 


irom it necess 
nonotone s 
the ine cToss the 
and continue into the 
although one 


and 


through 


whites if 


red fil 


i 
through 


positive 
reds, neu an 
red-filtered 
ilurmnis 


positive is 
tive is tungsten 

This negative—posi 
tion serves to exemplify 
which puzzle ever 
baffle me 
object may be 


the 


tions 
completely. Or 
cat h 
one ol very same rf 
tensity of the projection | 
would be on 


projec tors 


the screen if 


short res positives were 


But 


screen picture is monotone or a 


the negat 
tive t 
best bicolor [his is not because the 


negative is always so dense that all 
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surrounds contain essentially only 
the positive projec tor’s kind of light 

Land convinced me of that by pro- 
ecting a negative and positive of his 
standard objects slide" (illustrated 

Land, 1959a the 
bac kground in the mid 


it is about equally translucent 


“ here, since 


copy was a 
gray, 
n both positive and negative 
Another “achro- 
matic’ situa'.on is obtained by pro 


mysteriously 


ecting three identical positives made 
from any negative (color separation, 
or not) with two superimposed in 
one projector, the third alone in the 
filter 


other projector, and a color 


over cat h lens. The screen lox i again 


receive an enormous number of ratios 


of the two kinds of projection light 


Perhaps L ibled 


transparencies have always been loo 


ind’s “‘do gamma” 


dense ove most of their area, for | 


have learned of two other people, 


who have work in progress on this 


matter, who « the various hues 
’ 


mages’ situa- 


are situations in which 
ratios as such do not get 
clever 


to colors by 


our 


know why one doesn't 


ew colors when one mix 
lights is sur 
the 
In all of the situations 


id finds to be 


‘ olored 


other mixture of 


achromatic” there 


on teature, in that there 
regular 


progressions ol ratios 


is in itself is enough to lead him 


‘ 


expect no gaudy results. He justi- 


es his use of elaboratelv-c« mposed 


Nnotogr iphs to be gin with (instead 


’ , ’ ’ 
Tt screntiln 


spots-and-surrounds 
Mun- 


ran- 


‘scientific”’ 
that 
domness of the projection light in- 
and of 


ind montages of 


sell papers by insisting 


their 


tensity ratios 


topo 


the screen 


graphic distribution 


over 


is essential for the v iricolored etiect 


Such randomized conhgurations are, 


he says, natural; and it is in natural 
images that he has found the truth 
about color vision 

One of the 
“proves” the 
ness, and the color-killing effect of 
regularizing in any way the intensity- 


tests with which he 


necessity of random- 


ratio array on the screen, is the ex- 
periment with neutral step wedges. 
With two such wedges in place of 
oriented horizontally in 
one projector and one vertically in 
the other, and with a red filter over 


] 
slides, one 


one projector, one gets on the screen 
a huge square which is red in 
the opposite 
corner, and pink in between. Yet, a 
great number of intensity-ratios of 
the lights are there (256, to be exact), 
Land's beautiful 
long-and-short-record pictures 

When | asked for black grids to be 
the which would 
themselves registry wu the 
screen, and this was done, the screen 
but ex- 
Any illumi- 


only 


one white in 


corner, 


just as in one ol 


put on wedges, 


be in 


was no longer monotone 
hibited 
nated square now had, nearest to it, 
the 


were different enough to be capable 


several hue Ss 


other squares in which ratios 


of inducing something into the first 
To my 


showed that 


square own satisfaction this 
it is not randomness per 
se but discreteness that is essential, 
for the ratios in the squares were still 
in a regular topographic array. The 
Land's photographs of 
hodgepodges is that the easy way to 


local 


to create 


virtue ol 
get discreteness changes ol 
ratio large enough contours 

is by permitting randomness, which 
is rife in just such photographs 

And this, | strike my 
closing which is that | 
quite content with being able to ex 


with can 


note, am 
plain why Land gets what he does 


get, using only old knowledge and 


old language 
whatever of La 


use 


and making no 
id's fantastic new hy- 


potheses and new concepts. l leave 
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others to explain why he 
doesn't get what he doesn’t get, i.e., 
why the 
lacking where he has come to expect 


them, as in his various “‘achromatic”’ 


it for 


“unexpected” colors are 
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situations. In each of these, I am 


sure, some simple principle—which 
happens to escape nonmathe 


will explain the 


just 
matical 


non 


me 


appearance of “full color 
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THE EFFECTS OF VIOLATIONS OF ASSUMPTIONS 
UNDERLYING THE ?¢ TEST’ 
C. ALAN BONEAU 
Duke University 


As psychologists who periorm ir 
well aware, 
frequently 


1 research capacity ar 


psychological data too 


have an exasperating tendency to 


manifest themselves in a form which 
violates one or more of the assump- 
tions underlying the usual statistical 
Faced with the 


ilyzing suc h data, the 


tests of significance 
problem ol al 
researcher usually attempts to trans 
them that the 


tenable, or he may 


form such a way 


issumMptions are 
look elsewhere for a statistical test. 
rhe 


popular because of the proliferation 
oO the 


latter alternative has become 


so-called nonparametric or 


Phese 


he wwever, 


distribution-free methods 
techniques quite generally, 


their freedom from restricting 


couple 


issumptions with a disdain for much 


; 


information contained within 
ta. For example, by classifying 
and below 


nto groups above 


dian one ignores the fact that 
differences 


As a 


no assump- 


here are ntracatewgory 


between the individual scores 
result. tests which make 
tions about the d stribution trom 
’ 


which one is Sa! Ipling will tend not 


to reject the null hypothesis when it 


s actually I ilse as otten as will those 


ike 


power ol! 


whi h do m 


tests 


Chis 


assumptions 


lack of the nonpara- 
' This was undertaken while the 
author was a Public Health Service Research 
Fellow of the National Institute of Mental 
Health at Duke The computa- 
tions involved in this study were performed in 
University Digital Computing Lab 
is supported in part by Na- 
Grant G-6694 
wishes to express his appreciation 
us M. Gallie, Director of the Labora- 

tory, for his cooperation and assistance 


project 


University 


the Duke 


ratory which 
e Foundation 


a decided handicap 
as is frequently the case in 


metric tests is 
when, 
psychological research, a modicum 
of reinforcement in the form of an 


occasional significant result is re- 
quired to maintain the research re- 
sponse 

Confronted with this discouraging 
prospect and a perhaps equally dis- 
couraging one of laboriously trans- 
data, performing related 
ind then perhaps having diffi- 


interpreting results, the re- 


lorming 
tests, 
culty 
searcher is often tempted simply to 
ignore such considerations and go 
ahead and run a ¢ test or analysis of 
variance. In most cases, he is de- 
the that such a 


procedure will not solve the problem. 


terred by feeling 
If a significant result is forthcoming, 
is it due to differences between means, 
or is it due to the violation of assump- 
Phe latter possibility is usually 
sufficient to preclude the use of the 
tor F test. 

It might be suspected that one 
could finesse the whole problem of 
better 
planning of the experiment or by a 


tions? 


untenable assumptions by 


variables, 
but this may not always be the case 


more judicious choice of 
Let us examine the assumptions more 
closely It will be recalled that both 
the ¢ test and the closely related F 
test ol 
dicated on sampling from a normal 


analysis of variance are pre- 


A second assumption 
the derivations is that 
the 
the samples have been 


distribution 
required by 
the 

irom 


variances of distributions 
which 
taken is the same (assumption of 
rhirdly, 


used in 


49 


homogeneity of variance 


it is necessary that scores 





50 ’ ALAN BONEAIL 


the test exhibit independent errors 
The third assumption is usually not 
the 


most 


restrictive since researcher can 


readily conduct psychological 


research so that this requirement is 


satisfied The first two assumptions 


depend for their reasonableness i: 
upon 
empirical data and the chance shape 


(ertain 


part the vagaries inherent in 
of the sampling distribution 
situations also arise frequently which 
tend to produce results having in- 
trinsic non-normality or heterogene- 
For example, early 
in a paired-associate task, 
before much learning has taken place, 


ity of variance 


learning 


the modal number of responses for a 
group will be close to zero and any 
deviations will be in an upward dire 

tion. The distribution of responses 
will be skewed and will have a small 


With a 


of trials, scores will tend to be spread 


variance medium number 
over the whole possible range with a 
the center, a n nearly 
than before, but 


When the 


task has been learned by most of the 


mode at ore 
normal distributior 
with greater variance 
group, the distribution will be sk« wed 
downward and with smaller variance 
In this particular case, one would 
probably more closely ipproximate 
and 


data by using 


normality homogeneity in the 


some other measure, 
perhaps number of trials for mastery 
In many situations this option may 
not be present 

here is, however, evidence that 
the ordinary ¢ and F tests are nearly 
immune to violation of assumptions 
or can easily be made so if precau- 
tions are taken (Pearson, 1931: Bart- 
lett, 1935; Welch, 1937: Daniels, 
1938; Quensel, 1947; Gayen, 1950a, 
1950b; David & Johnson, 1951; Hor- 
snell, 1953: Box, 1954a, 1954b: Box 
& Anderson, 1955) 
psychologists have been apprised of 
1953 
results of 


Journey man 


this possibility by Lindquist 


who summarizes the 


study by Norton Norton's 


tex hnique was to obtain samples ol 


(1951) 


Fs by means of a randon Sal pling 
procedure from distributions hav 
but 


the same mean which 


the 


homogeneity of variance 


assumptions ol no 


termined fashions. As a 


Norton 


peree t me 


the effect of the violations, 
determined the obtained 
ol sample Fs which exceeded the the 
al 5% and 1% 

i 


F tables for various conditions 


oret values from the 


the null hypothesis is true, and 1! 


are met, the theoret 


assumptions 
values which would 
exceeded by chan e 
1“, ot the time 


tween these exper ted percentages an 


values ire } 
exac tly 5 


The discrepan be 


the obtained percentages 18 one use 


ful measure of the effects of the viola 

tions 
Norton's 

rized briefly 


] 1! 
samples all « 


results may be su i 
as follows 1) When the 


ime trom the 


the shape of the 


population, 
tion had very little effect or 
centage of F ratios exce 
! limits 
the 


theoretical lin 


theoreti For exa 


the 5°, level, perce! 
ceeding the 

7.83% for a leptokurti 
as one extreme discrepanc' 
skewed 
For sat 
populations having the sai 
but 
different shapes but the 


ittle effect « 


for an extremely 


is another 0 


different vari 


nces 


ance, there was 


empirical percentage exceeding the 
oretical limits, the average be ge be 
tween 6.5°), and 7.0% For san 
pling from populations with different 
shapes and heterogeneous variances, 
di betwee theo 


a serious screpancy 


retical and obtained percentages o« 
instances On the 


Lindqui 


that “‘ur 


curred in some 
basis of these results 
p KO con luded 


heterogeneity of either form or v 
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ince 18 so extreme as to be readily 
apparent upon inspection of the data, 
the effect upon the F distribution will 
probably be negligible.” 

This conclusion has apparently had 
little effect the 


statistical habits of research workers 


surprisingly upon 


or perhaps editors as is evident 
the 
tech 


reports T he 


om the increasit rellance up 

powerful nonparametri 
published 
this paper is to expound 
the ¢ 
test to 


trom 


invulnerability of 

of kin the F 

ights stemming 
assumptions of nor 

nd homogeneity In part 
this will be done by reporting results 
by the author 
m the ¢ test 
addi 


from a 


nptions. In 

evidence 

framework wil! be used 
ument 

logmatism 

suld be emph: 

are certain restri 

preclude in antomatK« 


ind / 


‘ , 
iss imp © 


tests with 

seven when 

otherwise ippli ible 

ior exal ple, that the 

Vari- 
j 


iSSU ptior is drastically dis 


ogeneity ol 


istribution of t's and 


to the d 


pie sizes are not the same 
1 possibility which was 

in the Norton study 

“ar that in cases ol 
one must have a 
enough to allow 
il effects of averaging 
nto play The need for such 
nsiderations will be made apparent 
There is 
that 


tests are much 


in the ensuing discussion 


ibundant evidence, however, 
both the ¢ and the / 
less affected by extreme violations 
of the assumptions than has been 


generally realized. 


A SAMPLING EXPERIMENT 
At this point we will concern our- 
with the the 
results of a random sampling study. 


selves statement of 
The procedure is one of computing a 
large number of ¢ values, each based 
upon samples drawn at random from 
distributions having specified char- 
constructing a fre 
the obtained 


was performed 


acteristics, ind 
quency distribution of 
t's lhe present study 


IBM 650 


puter progral 


Com 
the 
which can be 


on the Electronic 


nmed to piriorm 
necessary operations 
summarized as follows: (a) the gener- 

unber, (6) the 
the ra num- 
the 


the suc- 


ition of a random 
transtormation ol ndom 
ber into a random deviate fr ym 
appro] riate distribution, 

] ? 


Cessive at ul nation 


of the sums and 


sums of squares of the random devi- 


ates until the ippropriate sample size 
is reached, (d) the computation of a 


t based uron the sums an 


th 


’ 1 sums of 
squares col le two san ples, é 


the 
sorting of the t's on the basis of size 
ind the construction of a 
based upon 
he complete 


ind «Sl 


frequency distribution 


the sorting operatior 
sequence of operations was performed 
internally, the end result, the fre- 
quency distribution of 1000 f's, being 


pun he | out on IBM cards 


( n many of the above 


operations are relevant and will be 
made according to their order above. 


a T he 


sisted ot 10 


numbers con- 
the middle 10 
digits of the product of the previously 


r indom 


digits, 


generated random number and of one 
of a sequence of 10 permutations ol 
the 10 digits (0, 1, 2, ,9 
the 
start the process it was necessary to 


placed 
as multipliers in machine. To 
place in the machine a 10 digit ran- 
dom number selected from a table of 
The randomness 
such a 


random numbers 


of numbers generated in 
fashion was checked by sorting 5000 


of them into 50 categories on the 
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basis of the first 2 


digits. A x? was 
computed to determine the fit of the 
obtained distribution to a theoretical 
one consisting of 100 scores in each 
rhe obtained x? 
the 


which is the theoreti al 


of the 50 categories 
of 47.83 is 
49.332 value, 
the x’ 


extremely close to 


median of distribution with 
50 degrees of freedom 

(h) In order to obtain the random 
(the 


scores from the appropriate popula 


deviates individual random 


the random numbers obtained 
ibove fashion were considered 
numbers between 0 and 1 and 
interpre ted as the cumulative prob 
ibility for a particular score from the 
it ible 
j 


Mdom 


prese ribed popul itor From 
the n line, a ral 


having tl abil was 


entered in 
deviate 


selected This 1 t with the 


the 

the 
97.5%, ol 
rhe 


deviate 


procedure [ entering 
ordinary st - determine 


score below Say, 


the scores in the distribution lie 
obtains | 1 96. 1s 


val le, the 


responding hat umulative 


percentage n of such 


deviates fror , 
obtained by 
prob 


ueis 
sample of 
distributed Similar 

constructed for other 
The populatior 5 
study were the normal, the 
nential (J-sh iped with a skew to the 
having a density function of 


ind the 


popul itions 
selec ted ior this 


expo- 


right 
rectangular or uni 
These 
tions represent extremes ol skewness 
flatness t the 
7 he t ibles ol devi ites cor- 


y a 


distribution distribu- 


iorm 


and compare with 
normal 
responding to ear h of the selec ted dis 


tributions were contained internally 


iN BONEAIT 


in the computer and were so arranged 
that the 
was 0 and the variance 1 


mean of each distribution 
lo veril 
these values, population means and 
variances based on samples of 5000 
deviates from each of the three popu 
lations were estimated by the usua 
The 
normal distribution a 
of .0024 and a variance 
for the exponential a mea 
unce of 1.0475, and { 
rectangular a mean ol 0115 
9812. All of these res 


could quite easily have arise 


formulas results were 


, 
samp! 


ind a Vafri 


variance ol 


let rial ‘ 


sampling trom distribu + 


the 


randon) 


having assumed characteristics 


lo change the size of the v 


the population, all devi 


iriance ¢ 
ites 
yhied when nece 

n this « use, the 


distributior 


where M, and J 

the first and second sar 
and WN, are the 
This expressior 


ré Sp 
s1z7¢s 


lent statement of it 


cs book and 


~d in a preponder im 


h in which af? 


nonrelated means ts used 


out it statistic texts, this 


most 
when V 


not 


ire different 


appropriate iriance 


Tests are available 


which are more or less legitim ite ul 


der these conditions, but a certain 


amount of approximation is involved 


in them. It was felt, however, that 
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the ordinary ¢ test might under some 
conditions be as good an approxima- 
tion as the more complex forms of ¢ 
that 


was desirable 


a verification of this 
In addition, 
makes 


tests and 
notion 
the use of a 
pooled estimate of the 
error term and in this respect is simi- 


lar to the / 


Bex ause ol 


ibove formula 


variance for 


test of analysis of vari- 


ince this fact, certain 
results can be generalized from the f 
to the / 


lo sumn 


test 


irize, random samples 
were drawn from populations which 
were either normal, rectangular, or 
tial with means equal to 0 


l or 4 


yns of forms and varian es, 


exponel 
lances ol I or several 
{ tests of the significance ol the differ- 


between iple means were 
ymbinations of the 

15. For each of 

these combinat , frequency dis- 
tributions of sample t's were obtained 
IBM 650 


on the Electronic ( om- 


ter 
puter 


RESULTS 


results of the sampling study 
presented in part as a series 
iency distributions in the form 
the obtained distri 
tion of t's for a particular condi- 


I 


of bar graphs of 


von these have been super- 


’ 
posed the theoretical ¢ distribution 


ippropriate degrees of 
Chis furnishes a rapid com- 
t to which the em- 
the 


n ot the exter 
ution 


pariso 
rh il distr b contorms to 
onsider those combi- 
both of the 


distribu- 


when 
m normal 
but variances and sample sizes 
Next 
sampling from non- 


nay vary will be considered 


the results of 
normal distributions, but both sam- 
ples are from the same type ol dis- 
tribution. Finally we deal with the 


results of sampling from two differ- 
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ent kinds of populations, for example, 
one sample from the normal distri- 
bution, and another from the ex- 
ponential 

Potentially, a very large number of 
such combinations are possible. Limi- 
tations of the time available on the 
computer necessitated a paring down 


Although 


the computer is relatively fast when 


to a reason ible number 
optimally programmed, it neverthe 
less required almost an hour, on the 
comple te a 


1000 t's 


lrequene \ 
Che combi- 


average, to 
distribution of 
nations presented here are those 
which seemed most important at the 
time the study was made 

Asa 
tion of assumptions, the percentage of 
obtained t's which exceed the theoret- 
the middle 
of the ¢ distribution is used. For 
28 df which arise in the 


the 


easure of the effect of viola- 


ical values delineating 
95% 
8, 18, and 

study, corresponding 
respectively + 2.262, 
+ 2.048 If the as- 
the null 


means is 


present 
values 
+ 2.101, 


sumptions 


are 
and 
are met, and if 
hypothesis ol equality of 
true, 5% of the obtained f's should 


The differ- 


ence between this nominal value and 


fall outside these limits 


the actual value obtained by sam- 
pling should be a useful measure of the 
degree to which violation of as- 
sumptions changes the distribution 
of i scores. There is, of course, a ran- 
dom quality to the obtained percent- 
age of t's falling outside the theoretical 
limits Hence, the obtained value 
should be looked upon as an approxi- 
mation to the true value which 
should lie nearby 

In the figures and in the text, the 
various combinations of population, 
variance, and sample size will be 
represented symbolically in the fol- 
lowing form: F(0, 1)5-N(0, 4)15. 
Here the letters E, N, and R refer to 
the population from which the sam- 
ple was drawn, E for exponential- 
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Fic. 1. Empirical distribution of fs from 
V(O, 1)5-N(O, 1)5 and 


t with 8 df 


theoreti il distribu 


NV for nor ial, 
Che first number in the parenthesis is 


of the 


and R for rectangular. 


population distribu 
the 
The 

parenthesis 1s 
that 
ex ample ibove, the 


the meat 
tion, in all « while 


second number the variance 


iscs 


zero, 


followi 


the san ple 


number 
size for particular 
Sample In the 
first sample is of Size 5 from an ex 
ponential distribution having a vari 
ance ot 1 


a normal distribution 


The second sample is from 


with variance 


of 4 and the Sample size 1s 15 


Sampling from Normal Distribution 


g 
random 
this 
the 
the tabled values of 
| the 
the 


the 
utilized in 


In order to justify 
sampling approach 


stud, ind partly to contiirm 


faith placed in 


the mathematical statisticians, 


initial comparisons are between 


theoretical distributions and the ob- 
tained distributions with assumptions 


inviolate Figures 1 and 2 exhibit 


the empirical distributions of t's when 
both samples are taken from the same 
normal distribution with zero mean 


N(O, 


1 both samples are of 


and unit designated 


1). In 


Size 5, 


Variance 
Fig. 
while both are 15 in Fig. 2 
The theoretical curves, one for 8 df, 
the other for 28, represent quite well 
the obtained Ordi- 
nates approximately two units from 
the mean of the theoretical distribu- 
tions mark off the respective 5% lim- 


distributions 


its for rejecting the null hypothesis 
1,7 5.3% of 
these bounds, 
40% of 


since im 


In Fig the obtained t's 
outside 


fall 
Fig. 2 


while in 


only the sample t's 


are in excess both cases 


the expected value is exactly 5°), we 
must attribute the discrepancy to 


The 


random sampling fluctuations 


size of these discrepancies should be 


useful measures in evaluating the 


cout 


discrepancies which will be e1 


tered under other conditions of sam 


pling. For examples of 2000 t's a dis 


repancy as large as 1‘ from the 


‘ 


nominal 5°, value evice 


occurs 
frequently, and for this reason should 
not be considered as evidence to re 
ject the theoretical distribution as 
approximation to the en pir 
As an initial departure from tl 
simplest cases just presented, Fig 
compares theoretical and empirical 
distributions when samples are taken 
the same NV(0, 1 
but the first sample size is 5 
that is, V(0, 1)5 


While this in no sense is a 


trom population, 
the 


ond is 15 


of the assumptions of the ¢ test 
interesting to note that iga 

pling fluctuations have produced 
ith 4.0' 
the #'s falling outside the nominal 


limits 


empirical distribution w 


* The numbers in the tails of 
figures report the number of 
ing outside the boundaries 


Fic. 2. Empirical distribution of fs from 
N(0, 1)15-N(O, 1)15 and theoretical 
tion with 28 df 


listribu- 





VIOLATIONS OF ASSUMPTIONS 


The violation of the assumption of 
homogeneity of variance has effects as 
Fig. 4. Here the ob 
distribution is based upon 
two samples of Size 5, one from 
N(0, 1) and the other from N(0, 4 
rhe fit is again seen to be close be- 
tween theoretical and empirical dis- 
tributions, and 6.4%, of the obtained 
limits 


dep ted in 
tained 


t's exceed the theoretical 5% 


By increasing the sample size to 15, 
a distribution results (not shown here) 
only 4.9% of the ?#'s fall 
nominal limits. It would 


for which 
outside the 
that im reasing the sample size 
distribution which 
rather to the ¢ distri- 
As will be seen later, this is a 


secin 


produces a con- 


forms closely 


bution 


general result based upon 


quite 


ithematical co siderations, the im- 
plications of which are important to 
the argument. For the moment it is 
evident that 
it least in the ratio of 1 to 4 do not 


seriously affect the accuracy of prob- 


differences in variance 


ibility statements made on the basis 
of the ¢ test 

rhis last conclusion is true only so 
long as the size of both samples is the 
If the variances are different, 


with the 


same 
present set of conditions 
there are two combinations of vari- 
ce and sample size possible. In 
e case the first sample may be of 
Size 5 and drawn from the popula- 


tion with the smaller variance, while 


Fic. 3. Empirical distribution of t's from 
N(O, 1)5-N(O, 1)15 and theoretical dictribu- 
tion with 18 df 
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s 
ea ee 


: ) 2 5 ‘ 
mat ot 

Fic. 4. Empirical distribution of f's from 
N(O, 1)5-N(O, 4)5 and theoretical distribu- 
tion with df 
the second Size 15 is 
drawn from the population having 
the 1)5-N(0, 
4)15. the small 
sample size is coupled with the larger 


san ple ol 
larger variance—N(0O, 


In the second case 


variance, the larger sample size with 
the smaller variance—N(0, 4)5-N(0, 
1)15. 


sampling are presented in Fig 


rhe respective results of such 
5 and 


6 rhe empirical distributions are 
clearly not approximated by the ¢ 


distribution For the distribution 
of Fig. 5, only 1% of the obtained 
t's exceed the nominal 5% values, 
while in Fig. 6, 16% of the #'s fall 
outside those limits. 

There are good mathematical rea- 
sons why a difference in sample size 
should produce such decided dis- 
crepancies when the variances are un- 


equal. Recall that 2(X W)*/(N—1) 


is an estimate of the variance of the 


Fic. 5. Empirical distribution of t's from 
N(9, 1)5-N(O, 4)15 and theoretical distribu- 
tion with 18 df 
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Fic. 6. Empirical distribution of ¢’s from 
V(0, 4)5-N(O, 1)15 and theoretical distribu- 
tion with 18 df 


population from which the sample is 
drawn. Hence, =(X — M)? will in the 
long run be equal to (V—1)e*. The 
formula used in this study for com- 
puting ¢ makes use of this fact and, 
in addition, under the assumption 
that the variances of the populations 
from which the 


drawn are equal, pools the sum of the 


two Samples are 


squared deviations from the respec- 
tive sample means to get a better 
estimate That is 2(X,—M,;)? 
+2(X;—M,)? is an 
(N, —1)o,;?+(N:—1)e2" If o,2=¢,? 

a* (homogeneity of variance), then 
N;-—2)o? 


estimate ol 


the estimate (N, + 


Hence, 


sums 


M,)*+2(X,—M,)* 


f 
V,4N,—2 [1] 


If o,2#o,;* the 
estimating procedure is patently il- 
the 
pending in a large measure upon the 


estimate of o? 


is ani 


legitimate, resulting value de- 
combination of sample size and vari- 
ance used For example, the case 
N(0, 1)5-N(0,4)15 has N,; =5, N,=15, 
o,7=1, o2?=4, and N,+N,—2=18. 
With these values, Formula 1 has 
an expected value of [(4-1)+(14-4)] 
18 = 3.33 the appropriate 
values for the other situation, N(0, 
4)5-N(0, 1)15, the result of formula 
1 is [(4-4)+(14-1)]/18=1.67. This 


means that on the average, the de- 


Using 








nominator for the ¢ test will be larger 
for the first case than for the second 
If the sample differences between 
' 
uae 


means were of the same magni 


for the two cases, obviously more 


“significant” t's would emerge 
the 
happens that when this latter condi 


when 
denominator 1s smaller It so 
tion exists, the variance of the numer 
also tends to be greater than 


lact 


ator 
in the other condition, a which 
accentuates the differences betwee 
the two empiric al distributions 
Welch (1937 
matically that in 
und 15 


the per 


has shi wri 
the « 

sizes of 5 
vails here 
ceeding the nomin: 
as a function of tl 
population varia 
low as 0°, and ; 

If N, N, there is 

except perhaps in the « 
the sample sizes are bot! 


N, N; 10, the 


the percentage ol is 


expecte 
exces 
nominal 5°; limits vari 


and 6.5‘ { 


reg irdless ) 
the v iriances 


the 


between 
sample sizes, diser 
to be even less 

Since the pooling procedur 
mating the populati 
1. 


LiVSIS ¢ 


used in ordinary a! 


would Seer 


combination of unequal \ 


techniques, it 


unequal sample sizes mig! 
havoc with F test probability 
ments That is, a combi 
large variance and large samy 
should te! d to make the / tes 
conservative than the no 

lead one to 
the ¢ test, 


large sample size should produ 


would ex per 


with small varia 
higher 
Fs than ¢ K per ted 
are based upon a very simple exten 


percentage of “signi 
These conclu 
sion to more than two samples of the 


explanation for the behavior of the 


VIOLATIONS 


t test probabilities with unequal sam- 
ple sizes 

\ more sophisticated mathematical 
handling of the Box 
(1954a) reaches much the same con- 


, 
clusions tor 


problem by 


the simple-randomized 
analysis of variance. In a table in his 


article given exact (1.¢ mathe- 


ily determined probabilities 
of exceeding the 5% point when vari 


neces are unequal In this case, 
is assumed to be from nor- 
ributior - If 


sizes al same, the 


the sample 
probability 
given i qual ample sizes range 


7.42%, 


ations of vari inces, 


iron lor several! 


combit and num- 


bers of samples. If, when variances 


ire different, the san ples are of differ- 


ent sizes, large discrepancies from 


| | 
iominal values result 


Combining 
’ 


less 


ind large variance 


ens the probability of obtaining a 
result to much less than 
for the ?¢ 


1 subsequent article, Box 


significant 
5°), just as we have seen 
test Ir 
1954b 


two 


from 
Since 
have equal 
not 


preset ts some results 


sis ol variance 
designs generally 


the 


Way mary 
these 
7 | 
cell lrequencies results are 


His f gures 
value 


lar trom expected 

2% ol 
assumptions were met 
that both em 


in within the 5% 


m then 
mathematically there 


nstrated only a minor 
effect on the validity of probability 
ments caused by heterogeneity 


lance, prov ided the sizes of the 
his applies 


If how 
different, 


ire the same 
1! ; 


is the ¢ test 


ever, ! pie sizes are 
mairor error©rs ! 


ninterpretation may re- 


sult if normal curve thinking is used 


Sam t 


ling from Identical Non-Normal 


Distributions 


(Equal Variances) 

to violate the 
that of nor- 
from which 


Let us now proceed 
other main assumption, 
mality of distribution 


OF ASSUMPTIONS UNDERLYING 


THE t TEST 


sampling takes place. At this time 
we will consider the ¢ distributions 
arising when both samples are taken 
from the same non-normal distribu- 
tion The distributions shown here, 
and all subsequent ones, are based 
1000 t's, and hence will 
column to 


upon only 


exhibit somewhat more 
column fluctuation than the preced- 
ing distributions 

Figure 7 compares the theoretical 
t distribution and the empirical dis- 
tribution obtained from two samples 
of Size 5 from the exponential distri- 
bution—(0, 1)5-E(0, 1)5. The fit 
is fairly close, but the proportion of 
cases in the tails seems less for the 
empirical distribution than for the 
theoretical By count, 3 1% of the 
obtained t's exceed the nominal 5% 
values—that is, 


seems slightly conservative 


the test in this case 
If both 
sample sizes are raised to 15 (distri- 
bution not shown here), the corre- 
sponding percentage of obtained t's is 
4.0%. While this is probably not an 
appreciably better fit than for sam- 
ples of Size 5, we shall see later that 
there are theoretical reasons to sus- 
pect that increasing the sample size 
should better the approximation of 
the empirical curve by the theoretical 
no matter what the parent popula- 
tion may be 

If both samples are of Size 5 from 
the same rectangular distribution 


R(O, 1)5-R(O, 1)5—the result is as 


Fic. 7. Empirical distribution of f's from 
E(0, 1)5-E(0, 1)5 and theoretical distribu- 
tion with 8 df. 
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Che fit of theoreti- 
cal curve to empirical data here is as 
The 
percentage ol obtained t's exceeding 
the 5 


lar case 


depicted in Fig. 8 


good as any thus far observed 


“o Values is 5.1% in this particu- 
For the case in which the 
sample sizes are both 15 (not shown 
the fit 


of the cases falling outside of the 


here is equally good, wit! 
5.0 


nominal 5°, bounds 


Sampling from Non-Normal Distribu- 


tions: (Unequal Variances 


We may assume that if the vari- 
n il, and at 
are 


the same 
different, 
Ing distributior 7 from nor 


iwmces are wu equ 


time the sample sizes 


the result 
normal populations will be affected 


in the same way as the distributions 


derived from normal populations, 


and for the same re These cases 


isons 
will not be considered 


If sampling is in sizes of 5 from 


two exponential distributions, one 
with a variance of 1, and the other of 
4. a skewed distribution of obtained 
t's emerges (not shown We 
hall skewed distri 


Sila 


bution 


here 
discover that a 


of t's erally arises when 
distrit 
of skew- 
For an explana- 
of E(0, 1)5- 


Apparently, the 


it 


the sampling is trom utions 


which are di nt degree 
mmetry 
discussior 
below 
etliect } in i ! 1? Variance 
the exponential 
present case 5 } ), 4 
to make the negative sample me 


arising from the distribution 


larger Variance even more negative 


with 
pe r- 
Sor 


nominal r 


than those from the distribution 
In 


the 


smaller variance terms of 
entage exceeding 
7¢ 


imits for this case, the value is 8.3% 


! 
i 


of which 7.6‘ 
tail This 


ind distribution was not tested with 


comes from the skewed 
ombination of variances 
larger samples, but we shall see when 
comparing exponential and normal 


distributions that an increase in the 
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Fic. 8. Empirical distribution of fs fre 
R(O, 1)5-R(O. 1)5 theoretica! ’ distrib 
tion with 8 d/ 


and 


si7¢ de« reases thre 


obtained t 


rle 
distributior 
retically, this 


} 


dex rease 
in ilmost all « | 


1Se€s, 1! 
ent one 


Phe 


cated if 


result is mi 

while variances 

ent, the sampling is from sy 

rectangular distributior 
5. For this sm 

not 

a distribution 

7.1% of 


nominal 5° 


illustrated 
of 


the \ 1¢s 


obta 


pou ts 


the same magnitude 
discrepancy 
For the 


that an 


spor dit “4 
distributions 
be rec alled 
san ple sizes to 15 decre 

19 
is no re ison to believe t! 

the of the 


would not have 


tained per entage to 


size rect 


the 
However, time di 


terminaiton of this d 


Sampling from 


bution 


By drawing the first 


a distribution having o 


and by drawing the secor 


distribution having another shape 


other than shape differences arising 


from heterogeneity ol variance), vet 


way has been found to do 


violence to the integrity of the as 


another 
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sumptions underlying the ¢ test. Per- 
haps the least violent of these hap- 
penings is that in which at least one 
of the populations is normal 

When one sample is from the ex 
ponential distribution and the other 
from the normal, the interesting re- 


sult shown in I iw. ¥Y occurs This is 
the small sample case—E(0, 1)5- 
V(0,1)5 It will be that 


for skewed mean 


median are at 


rec alled 
distributions the 
and different points 
In the exponential distributions, for 
example, the mean is at the 63rd cen- 
tile. If samples from the exponential 
distribution are small, there will be a 
tendency for the sample mean to be 
the population mean, obvi 
two thirds of the 


since 


less than 
ously since nearly 


scores are below that mean 


the population mean of the present 


' 
distributions is 0, the result will be a 


preponderance ol negative sample 
If the other 
s taken from a symmetrical 
tend to 


pr du i iny positive as negative 


means tor small sam} les 


which would 
, ! } | j 
sample means, the resulting distribu- 
tion of obtained t's would not balance 
about its zero point, anin balance ex 
erbated by small samples In I ig 
9, 7.1' 


of the obtained cases fall out 
the § limits, 


with most, 5.6°, 
[he effect of 
increasing the sample size to 15 is to 


the distribution 


side 


lying in the skewed tail 


( onsider 
10, is 


bor ilize 


ably; the resulting curve, Fig 


JTSS 
‘em 


mut ot 


Fie. 9 C% distribution of i's from 
EO, 1)5-N(O, 1)5 


tion with 8 df 


and theoretical distribu 
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Fic. 10. Empirical distribution of t's from 
FE 0, 1 15-N(O, 1)15 and theoretical distribu- 
tion with 28 df 


fairly well approximated by the ¢ dis- 
tribution. One of the tails, however, 
does contain a disproportionate share 
4.2% to 0.9% for the 
1 total of 5.1% falling 
outside the nominal 5% limits. Nev- 


which the 


of the cases, 
other tail, or 
ertheless, the degree to 
theoretical and empirical distribu 
tions coincide under these conditions 
that if 


likely ! 
both samples were each of Size 25, 


is striking It seems 
the resulting sample distribution of 
t's would be virtually 
able from the ¢ distribution for 48 df, 
best thing, the 


lo test this hypothesis, 


indistinguish- 


or the next normal 
curve itself 
in additional empirical ¢ distribution 
based on sample sizes of 25 from these 
same exponential and normal popula 
not shown here). 
pre- 
with the 
46°, ol 
surpassing them 
samples the 


tions was obtained 
The 


sumption 


results nicely confirm tl 
(on parison 
usual 5% values reveals 
the empirical fs 
Whereas with the smalle 
ratio of t's in the skewed tail to those 
in the other tail is roughly 80:20, the 
corresponding ratio for the larger 
sample case is 59:41. Clearly, the in 
crease in sample sizes has tended to 
normalize the distribution of ?t’s. 

conditions, involving 


For these 


rather drastic violation of the mathe 
matical assumptions of the test, the 
t test has been observed to fare well 


with an adequate sample size. Such 
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a state of affairs is to be expected 
theoretically By invoking a few 
theorems of mathematical statistics 
it can be shown that if one samples 
from any two populations for which 
the Central Limit holds, 
(almost any population that a psy- 
chologist might be confronted with 


Theorem 


no matter what the variances may be, 


the use of equal sample sizes insures 
that the resulting distribution of ?¢'s 
will approach normality as a limit 


It would appear from the present re- 
sults that the approach to normality 
is rather rapid, since samples ol sizes 
of 15 are generally sufficient to undo 
most of the damage inflicted by vio 
lation of Only in ex- 
treme cases, such as the last which 


assumptions 


differing in 
that slightly 
larger sizes are prescribed 


involves distributions 


skew, would it seem 
Thus it 
would appear that the ¢ test is func- 
tionally a distribution-free test, pro 
viding the sample sizes are sufficient 
ly large (say, 30, for extreme viola 
tions 


rhe 


sampling is from the 


and equal 


distributions arising when 
normal and the 
rectangular distributions N 0, 1)5- 
R(O, 1)5 and N(O, 1)15-R(O, 1)15 

would further tend to substantiate 
this claim The 


exceeding 


respective percent- 
the 5% nominal 


4.6% 


the empirical distributions for these 


ages 
5.6% and from 


values are 


; 


the distributions of ?¢'s being 
the theo 


cases, 
and close to 


retical (not shown). 


symmetrical 


The only other combination exam 
ined in the sampling study is the un 
of exponential and 
rectangular distributions. This dis 
tribution (not shown) is again skewed 
with the effect of increase of sample 
size from 5 to 15 to cut down the 
skew and to decrease the percentage 
of cases falling outside the theoretical 
For 


interesting case 


‘ 


5% values from 6.4% to 5.6%. 
those cases falling outside the nomi- 


nal 5% values, the ratio is 79:21 for 
the smaller samples. This is changed 
to 69:31 for the sample size of 15 
Here again it would seem that larger 
sample sizes would be required to in 
sure the validity of probability state 
ments utilizing the ¢ distribution as 
a model. 

rhe results of the total study are 


Table 1 which 


for each combination of population, 


summarized in vives 


variance, and sample size (a) the per 


centage of obtained ?'s falling outside 
the nominal 5% probability lin 


t distribution, ar 


ts ol 


the ordinary 1 (bd 


the percentage of obtained ('s falling 
outside the 1% limits. The combina 
tions are represented symbolically as 
before. The table is divided into two 
parts, the first part presenting infor 
mation on the empirical distributions 
which are intrinsically symmetrical 
Ihe second part is based upon the in 
al distribu 
this 


trinsically nonsymmetri 
tions, additional information in 
section of the table being the percent 
age of obtained t's falling in the larger 
of the tails 


smaller tail may be obtained by 


The percentage for the 
sub 
traction of the percentage in the l 
er tail from the total 

Certain implications of the 
In the Norto 


study, more severe distortions 


table 


should be discussed 


times occurred with significance 
els of 1% and .1% than 
with the 5% level. The inclusix 
Table 1 of the 
tained t's falling outside the 

1% values makes possible the 
the 1% and 5% 


parison ol 
values seem to be ipprox) 


Phe 1% 
} 


mately what would be expected con 


ippeare 


percentages 


results 


sidering that sampling fluctuations 


are oct urring It was not felt feasible 
to determine the results for the .1' 
level with 1000 or 


cases the number of obtained (t's fall 


since only 2000 


ing outside the prescribed limits was 


pos 


negligible in most cases. It is 
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sible, however, that the distortions in 


the apparent level of significance are 


for the smaller a values. 
and discussion 
thus far to the 


more drasti 

All the 
have limited 
two-tailed ¢ test. With notable ex- 
ceptions, the have 
reached can be applied directly to the 
one-tailed ft well. The ex- 
those distributions 
asymmetric 
In these distributions 


results 
been 


com lusions we 


test as 
ceptions involve 
which are intrinsically 


lable 1 


a preponderance of the obtained ?'s 


(see 


Depending upon the 
involved in 


fall in one tail 
tail 
tailed test the use of t should produce 


particular the one- 


too many or too tew significant re 


rABLE 1 


OBTAINED PERCENTAGES OF Cases FALLING 
OUTSIDE THE APPROPRIATE TABLED ¢ 
VALUES FoR THE 5% AnD 1% Levet 

OF SIGNIFICANCE 


Obtained Percentag 
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sults when sampling is from a combi- 
nation of populations from which an 
asymmetric ‘ distribution is expected. 
It seems make any 
simple stateiments about the behav- 


yossible to 


ior of the tails in the general case of 
asymmetric ¢ distribution except to 
say that such distributions are ex- 
pected whenever the skew of the two 
parent populations is different. The 
experimenter must determine for 
each particular instance the direction 
of skew of the expected distribution 

Table 1 gives 
symmetric dis- 


and act accordingly 
for the intrinsically 
tributions the total percentage of ob- 
tained t's falling outside the theo- 
retical 5% and 1% limits and the per- 
the larger tai From 
he assessed the ap- 
proximate ma ude of the bias in- 
curred when a une-tailed test is used 


centage in 
these values can 


in specific situations 


DISCUSSION AND CONCLUSIONS 


Having violated a number of as- 
sumptions underlying the ¢ test, and 
finding that, by and large, such vio- 
a minimal effect on 
of t's, we must con- 
a remarkably 


il sense of 


lations produce 
the distributior 
clude that the ¢ tes’ is 
robust test in the techr 
the word. This term was introduced 
by Box (1953) to characterize sta- 
tistical tests which are only inconse- 
quentially affected by a violation of 
the underlying assumptions. Every 
statistical test is in part a test of the 
assumptions upon which it is based 


For example, the null hypothesis of a 


particular test may be concerned 
with sample means. If, however, the 
assumptions underlying the test are 
not met, the result may be 
even though the population 
li the statisti- 
insensitive to 


“signifi- 
cant” 
means are the same. 
relatively 
violations of the assumptions other 
than the null hypothesis, and, hence, 
il probability statements refer pri- 


cal test is 
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marily to the null hypotheses, it is 
The ¢ and / 


apparently possess this quality to a 


said to be robust tests 
high degree 

In this particular context, an im 
example of a test lacking 
Bartlett's test for 
Bartlett 


has shown that 


portant 
robustness is 
homogeneity ol variance 
1937 Box (1953 
this test is extremely sensitive to 
non-normality and ll 
be p 
results even il ri 
For Box 


ol exac I abil 


ex imple, 
‘ 


» I rmal 


Bartlet 


theory 
e level 


arious le vels 
neter, tor differ 


' ~— |} , 
ces Del 


00001 


cases, 


iS atlecté 
he terogeneous 


normauty 


nonrol 


homogeneity 
o the same weakness 
We may conclude that for 
number of iffere Situations col 
the the 
the ordinary 


i large 


fronting researcher 


7 


table will result in probability 


ments which are accurate to 


degree, even though the assumptions 
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of homogeneity of variance and nor 
the 
tions are untenable 
ber of 


mality of underlying distribu 


This large num 


situations has the tollowing 


] 
' 


characteristics a the two 


genera 
Sample 


b) the 
t10 distributions are olf 


sizes are equal or 
assumed underlyi 
or nearly so | 
are skewed the‘ 
Vatia 


nearly the same 


; e} 


conditions are me T 


what the variance differs 
be, san 
produce resul 

probab ity 


pothesis 


than likel 


If the s 


those by 
Satterthwa 
1947 Che Wel 
is interesting since it I 
tended by 
indomize¢ 
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The Fisher-Behre 
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igvested D 
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some statisticians (e.g 


Bancroft, 1952, p 
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. however, the distribu 
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difficulty 
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to bias probability state 
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of which 


ithusiasm and vali 


projective ethods, most 
ire gree ted withe 


nt 


The early 
projet tive 
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produced 
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tion 


ne assum was 
projective test 
he X ray 

inilormation 

nt without 

influenced by the person 


the meth- 


was 


I rank, 
only 


as 


im any 


stered the test 


idministration, or the situation 


hich it was used In the words ol 
1956 Test research has 


b cl 
by the 


Galtonian 
iple of the 
; to a standardized 
is’’ (p. 175 


with growing sophistica 


iS a Sal 


stimu | 
lowever 


rewarding the nature ol psycho 
| ol 


il ft 
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test number writers 


x, a 


ective testing ol factors 
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juence in pro 
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of the 
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to the 
Rors« hach 
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delineate sub 
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who des ribed 
the Ror 
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mou}; ele 


schach situatior 
the EF and S; the assignment 


to the S: the 


iSK DS 
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projective 


to the S's behavior; 


and 

the specifi qualities of the task, such 
or the lack of fa 
the stimuli Miller 
1954), and Luchins 


have also indicated the subtle 


nterpret 


as the ambiguity 
miliarity with 
1953 A Sarason 
1947 
ways in which subjective forces may 
influence the course of a projective 
testing situation. 

It is the purpose ol this paper to 
the considerable evidence 


garding situational 


review re- 
and inter personal 
I x- 


with the effects of 


influences in projective testing 


periments de iling 


these factors on interviewing or in- 


telligence testing and those studies 


concerning the effects of psv¢ hother 


apy, psychosurgery, and individual 


vs. group tests will not be reviewed, 
to 


since these issucs re consi ered 


il 
lly different prob 


be part of essentia 


lems Four arbitrary, 
ill be present 


nethod of admi 


overlapping 


( itegories w used to 
these studies 


tion, 


nistra 


the testir gy Situation 


examiner 


influence, and subject influence 


or METHOD 
ADMINISTRATION 


INFLUENCI 
OF 


rw 


In 


‘ Dre 
1m j re 


tructions to make a good or bad 
sston. The ability of projective 
to attempts by Ss 


their 


tests withsta 


to disguise or alter real re 


sponses has been investigated sev 


eral times. The usual procedure in 


these studies is to test the same Ss 


several times under instruc- 


} ide be- 


tween the test responses produced un- 


varying 


tions; comparisons are then 1 


der standard instructions with those 
yielded by experimental instructions 
1938, 1941, 1943) has re- 
ported on the process of trying to 


Fosberg 
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produce a good or bad impression on good impression ("‘you are in a state 
the Rorschach. In one study (Fos- hospital and the results on this test 
berg, 1938) a husband and wife were may help get you out 

each administeréd the Rorschach instructions to m 


under four sets of instructions : sion you 


spite the instructions t Army ind the results 


given impression, it was yncl . may Ip keep you out 
that the Ss were unable ) sign int group differe 
revealing b ts for the s score, significa 
sonality he psvch am ' ie fou level “This does not 
examinatior ining lly ever, that no changes were 
the same i | \ ) > Gal vy showed 
berg 


| 


ressions 


We sskop! 


ted st tbhbort ! two 


ceeded very slo tour . . SeNZWCIR P-| 


little attentior osberg, 1943 me ympletion test 

Fosberg’s studi were essent ally lati ot instruc 
repeated by ( arp al d Sh ivzZzin 1950 tru (one yrou 
who also found that taking the Ror multiple 


schach under i ictions to make f it 
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while a third group was told in taking 
the test to try to make the best im- 
pression. It was concluded that as 
the test became less ambiguous, the 
results more closely resembled re 
sponses produced under instructions 
to fake 

em pha 


Instruction sizing particular 


determinants or locations. In the proc 
ess of studying suggestibility, (Coffin 
(1941 
influence 
h test 


to read a fictitious 


demonstrated how S's set may 
responses to the Ror 
The Ss were first asked 
a “Har- 


pro 


his 

“4 ha 
| 

irticie by 


vard protessor des ribing how 


‘ ; ] 
fessional men usual saw whole re- 


= 
sponses, while busine SS men saw ani 


skilled laborers saw inanimate 


mals, 
ob ects and \W P’ \ empioyees saW de 
A se 


that now 


tails ond group of Ss read the 


lescribed protes 


nen as seeing details, business 


nimate objects, et F ollow- 


reading of this article each 


idministered six Rorschach 


The results clearly showed the 


afi 


fluence of the sugwestion on the re 


each group tending to re 


direction as the 
‘Appar 


sets upa deter 


the same 

a cept ible norms 

the sugwvestion 
ng te lency operating upon the 
imaginal 
the 


observer's 


perceptual and 


acted 


to direct 


processes lhis 

ntrolled study 
equ ited two groups 
(he 


basis ol 


S of 
yonses to the first 
Rorschach 


was then told that 


the 


s and professional 


whol while the 


that 
iil responses. Asa 


of the difference in in 
the 


e re sponses 


| group was instructed 


seco 


these men saw cet 
cot! sequence 


structions, two groups differed 


significan yo the sc ond Rors ha h 


in the number of whok 


ind detail responses but on several 


other determinants (F%, FM, m, 
Hd, Ad) as well, although there were 
no significant differences between 
groups on the first test. Evidently es- 
tablishing a set for area will also af- 
fect those determinants dependent 
upon the 
dence of Keyes (1954 


the notion that the number of whole 


area of the blot The evi- 


' 
also supported 


responses can be influenced by special 

instructions 
Hutt, Gibby, 

1950) and 


etiects ol 


Milton, 
Gibb 


and Pott- 
harst 1951) in- 


vest ited the instructing 


Ss to pay particular attention to 
of the 
In each study various parts of 
the 


administra- 


specili aspects Rors hach 


the Dlots were emphasized to 
Ss after the 
tion of the test, but prior to the ex- 
\ study 
Ror- 


schach under these conditions showed 


standard 


perimental administrations 


of test-retest reliability of the 


certain determinants to e more 
stable 


than 


to change 
to be 


resistant 
‘What 
how the 


total test 


and less 


others ippears 


crucial is individual per- 
Situation If we 
are likely to 


interpreta- 


ceives the 
know this, we 


rious errors if} 
administering the Ror- 
r standard instructions, 
1954), in his 
mental 


ibrikant instructions 


the exper group, stressed 


shading, tex 


In the experimental 


color, and 


vement, 
t re responses 
group, 15 Ss showed differences be- 


twee first and second administra- 


tions in at least 3 of the 4 response 


catewories, wn le in re control group 


only 3 Ss showed Significant changes 
in at least 3 categories 

regarding the 
The 
evidence regarding the effects of tell- 
ing the S the the 
ing comes from the study of Henry 
a id 1956 


their experimental group of female 


Instruction pur pose 


oj the lesling most impressive 


test- 


purpose ol 


Rotter who simply told 
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what most college 
already presumably 
about Rorschach test 
television, the and 


to 


undergraduates 
students have 
learned 
from 


Life n 


discover 


the 
movies, 
test 


emotional disturb 


wazine: “This is a 
serious 
ances.”’ It was found that the experi- 
mental fewer 


at the 


group 


01 
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level), more good form 
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05 level) and 


O5 than 


level 


responses 


respons more animal 


responses level a control 


} 
group 
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administra 
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given a standard 


evident making 
expli it tne 
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attempts t 


more 
» be safe than leaving the 
unstated 

by Calder 

the 
involvement 

the 


purpose 

A study 
1953 
both 
tions 


investig ated 
ego 
regarding 
Rorschach test 
high 


voiving instructions 


school Ss wert 
were 


third 


Rot 


utral instructior ‘ 


Ss 


vyiven fhe 
of the 


ss 


were told tl ne 


tested intellige.;ce, 


hach 
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and the last group that it 
Ar i il 
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SS, 
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ysis of variance 
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the 
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05 level 


' 
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the nstruc 
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tou Her 
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picture ry and 
respo!r Ses 


de 


predic 


y. movement 
“Needless to 
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ich 


responses 
say 
sed on interpretations 


Rorscl protocol, withou 
ge of the testing situation « 
the 
fallible 


results ot th 


ictions to testing ire 


more when 


Vie wed 


been ised to 
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the « 


ilso 


inforn S 


fiects ol 
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of the purpose of the test (Sum- 
merwell, Campbell, & Sarason, 1958 

Four different groups were used, each 
group receiving one of the following 
instructions regarding the purpose ol 
the test: (a) the Murray in 


str intelligence test 


usual 


ictions 


in 


structions, projective test in 


neutral instructions 
that 


structions produced signincal tly dif 


structions, (d 


It was found the neutral in 


ferent emotionally toned stories than 


any of the other three groups, with 


' 
story outcomes significant! 


Murray 


is and the projective tes 


from the standard 
tio 
ions 

The manipulation of time of re 
giving the group Ror 
10 Ss under conditions of 
3 min 


| 


sponse In 
“ h ick to 
long time exposure 
10 


th it 


ind short 
We isskop! 


the same 


time 
1942 


ality pattern 
dit of 


exposure 


noted 


person 
per 


emerged 
ions admunistratt 


ely, adequate experit 
s were fi employed \ 
us procedure was 


105 


utilized by 


pola and Taylor who gave 
the 


Ss seated 


Rorschach test to experimental 


in front of a nosy 


mer which recorded react 


of the 


matt 


time first response It 


’ 
that the 


' 
resulted 


] ; 
cluded pressure 


+} 


by 


beh iving ul ler tr 


timer 


turbed patients 


situatior he 


seems to be that the projective pro 


ess 


like any other psychological prox 


ess, is not immune to the influences of 


the specif conditio 


46 


operates p 


[He INFLUENCI 
TESTING SITUATION 


Che designs for the studies 


vest! 


gating the effects of Varying ing 
Phe 


conditions take several forme 





VARIABLES IN PROJECTIVE TESTING 69 


most rigorous of *\ese utilizes a con- 
trol group that . .s been given two 
administrations of the test to con- 
trast with the experimental group 
which had experienced the special 
conditions between the first and 
second testing. If the projective test 
permits, some investigators prefer to 
counterbalance the order of presenta- 
tion of the particular cards used 
necessitating at least two experimen 
tal groups and two control groups 
Another frequent not 
control only 


does 
the 


design 


utilize a group, 


comparison made being that of the 


first administration of the test with 
the second administration, with al! 
differences between administrations 
assumed to be a function of the inter- 
vening conditions. A third procedure 
consists of administering a single test 
to groups known to differ on a par- 
ticular dimension; all differences in 
test results are then attributed to the 
central, identifiable difference be- 
tween the groups 

The 
matic effort to induce eiress was * ‘iat 
of Lindzey (1950a, 1950b), who frus- 
trated his experimental Ss by sub- 
them to 10-12 hours of food 
deprivation, inducing them to drink 
a large quantity of water and then 


Stress. most veful, sys*e- 


jecting 


preventing them from urinating for 
approximately three hours, taking a 
blood sample in a painful way with 
a spring lancet, and by forcing them 
to fail in a group As a 
consequence of these conditions the 
Rosenzweig Picture Frustration Test 


situation, 


increase in 
extra-punitive (Lindzey, 
1950b). Of 12 predictions regarding 
changes in the TAT, 11 were in the 
expected with 5 hypo- 
theses confirmed at the .05 level of 
confidence or better (Lindzey & Her- 
man, 1955 
the 
studied by 


showed a significant 


responses 


direction, 


The effects of stress on 


Rosenzweig P-F test were also 


French (1950) who gave 


students in a social psychology class 
erroneous grades on an examination. 
Half the students who earned an A or 
B were given C or D, while half 
those earning a C or D were given an 
A or B. On the P-F test given im- 
mediately after the grades were re- 
turned the good students given the 
poor grades (the stress group) did 
not differ from the good students who 
were assigned their correct grades. 
However, the poor students given 
the erroneously high grades showed 
fewer intropunitive ego-defensive re- 
sponses than the poor students given 
their correct grade. 

kichler (1951) an elaborate 
device resembling an electric chair to 
his Ss while taking the Ror- 
They were made to wear a 
helmet which looked as if it could 
conduct electricity were told 
that while taking the test they would 
be given shock, ‘‘the longer thx 2 
interval that without th 
receipt of shock the ‘nore intense 
the next shock will be."” <= ‘he basis 
of an adrinistration of the Behn- 
Rorschach test, the experimental 
group was matched on five variables 
with a control group that took the 
second Rorschach under standard 
conditions. Judges who made a blind 
global rating of the Rorschach proto- 
cols found a significant difference in 
anxiety between the two groups. On 
15 anxiety indicators, however, they 
found that only 4 reflected a signifi- 
cant difference between groups while 
3 additional variables did not reach 
but were in 


used 


seat 


schach 


ant 


elapses 


statistical significance 
the predicted direction. 

Less dramatic forms of frustration 
seem also to be effective in demon- 
strating how projective devices may 
reflect pretest conditions. Crandall’s 
(1951) experimental Ss took tests of 
physical skills between administra- 
PAT and were informed 
“norm.’ 


tions of the 
that they had not meet the 
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A control group rested between test 
administrations As a result of the 
failure situation the experimental Ss’ 
for punishment as 


rAl 


expectation 

vealed in the 

cantly 
Schwartz and 


posed stress by 


re- 
increased signifi- 
(1957) im 


36 a 


Kates 
giving their 
“interpretation” of their 


Behn-Rorschach re 


hictitious 
Rors« hach or 
sponses, showing them to be poorly 
When the second test was 
2 (FC and RT) of 
variable s 


adjusted 
1dministered only 
160 prese lected Rorschach 
incant 


of the stress 


showed sig: differences as a 


functior 

Che best adjusted and most poorly 
NYA « 
made to fail in performing with 
the Rotter Level of Aspiration Board 
Che \T 
records of the two groups differed i 


the 


idjusted members of amp 


were 


pre- and postfrustration | 


several ways, poorly adjusted 


group showing a decrease in themes o 


aggression, and emo 


Rodnick & Klebanoff 


superiority, 

tional states 

1942 
Phree studies did not in pose stress 


but OSs I 


‘natural’’ stress conditions 


experimental! utilized 


K latsk 


1952) gave the Rorschach test to o 


group of patients the day before 


were to receive gynecological sur 


and to another group ol pa 
Ios 
gay 


the were to 


} 


charged from the obstetrical serv 


before 


lhe hospital patie! ts 
and if tell 
(i 


on age ue a “group 


the 


made bet wee T ] 21 


' ’ 
ol clerks comparisons 


significar 


differences were ind, yener ally 


iter constrictl« 
] , 
seit preoc uUpatliol 


pitalized 5s In anot he 
which utilized hospitalized Ss, Meyer 
found that 


before SuT- 


Brown ind Levine 1955 


H-T 
gery 
shes 


bial 


the 


P draw nes sec ured 


indicated far more rewression 


arent either cli illy or 


postoper itive draw | : The 
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contrast between the pre- and post 
operative drawings were often so ar 
to 
be ng the product of the same 


ul 
431 Abel (1953 


conflicting patterns 


resting as cast doubt upon their 
indi 
vidual” (p how 
found 


san figure drawings 


ever, 
h in 


erated on tor correction 


Some p 


hgurement 
great chat ges in draw 
ol corrective surgery 
while st 


hange 


, , , 
littie change 


ade dramatic « 


no sure 


ve though 
verformed 


Bellak (1944 


conditrons | t ot 


' 
’ 


ministration bv cri 


stories are about the 
heard ets the S 
through the test 

that the 


stories toll 


irks were charactet 
iweressive W 
trol gruup 


The et 


dr iS have bee 


fects 


prorvective cde‘ 


Wh 


hach be 


Rors« hae h 


of a Rors 
iter 


achns given ul 


there 


per itting more de 
ol perso! ality Kell 


berton « 
Ss vive 


1941 W he 


oxygen through a is 


Katz 


reat hed i Simm ilate | altit {16.000 


r Rors« h if hs sh 
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an increase in color responses (Hertz- 
man & Seitz, 1942). 
and color responses showed striking 
the 
influence of mescaline (Guttman, 
1936). Werthman and Bleuler (1932) 
have that the Rorschach 


under mescaline corre- 


Movement 


changes when the S was under 


rey rted 
test given 
wre closely to the person- 
than the 


also re 


sponded m 
known in life 
They 
considerable difficulty in 


ality as 
standard Rorschach 
ported the 
holding the experimental S to the task 
of attending to the Rorschach when 
med to attend his 


he see preter To 


own images The administration ol 
hyoscine toan S afflicted with enceph- 
inconsistent changes 


1947 


these experiments 


ilitis produced 
in the Rorschach (Cofer, 
WW hile most .Ss 1n 


were badgered, frustrated and other 


wise treated unpleasantly, in three 


serve ! liquor in 
test 


915 


studies Os were 


return for taking a projective 


In one investigation, between 


ounces of 100 bourbon were 


proot 


served between administrations of 
the 
the experiment support the unsystem 


drinkers 


ow! under 


Rorschach The conclusions of 
who 
the 
accuracy ot per 
details, 
critical attitudes and self-controlling 
ittitudes decrease 
& McMichael, 1954 Studies using 
the TAT (Tompkins, 1942) and the 
Rorschach & Berrera, 1941 
ugree that projective responses given 
the S is 


de tails but do not 


atic observ ifions of 
have to buy the 
ilcohol, 


ittention to 


influer ce ol 
ception, self- 


Rabin, Papania, 


Kelley 


when intoxicated may vary 


differ in 


minof;r 
iny consistent manner irom responses 
given when sober 

Whether (1943 
subjected to noxious or pleasant test 
difficult 


to make, since he administered mor- 


Brown's Ss were 


conditions is a distinction 


phine to 22 postaddict patients who 


had previously been abstinent from 


the drug for a minimum of s1x 


not 
from 


months. If the Ss did experi- 
the “right the 
first experimental injection, the dose 


ence feeling” 
was increased until a euphoric state 
was reached. It was reported that 
intellectual control, originality, and 
organizational energy were not af- 
fected by morphine, but there was a 
shifting to greater imaginative living 
There was no report on subsequent 
attitudes by the Ss toward the drug 
or this particular method of admin- 
istering the Rorschach 

Hypnosis The use of hypnosis 
with resistant test Ss was reported 
by Wilkins and Adams (1947) 
found that this method produced co- 
test 
intensively by 


W ho 


record 
hav- 


operation and a useful 
studied 


different 
while under hypnosis, was variously 


One S 


ing seven moods induced 
instructed that she was grief stricken, 


euphoric, concerned about an und:- 
agnosed illne ss, de pressed carrying on 
an extramarital affair, etc. While the 
content of the Rorschach tests given 
the 


changed from role to role, the sim- 


immediately after instructions 


ilarity between records was great 
enough to show that the same under- 
lying personality was being observed 

Grassi, & 1943, 
\ similar procedure was em- 
1939) who told his 


Sin one hypnotic session that she was 


Levine, Gerson 


1944 
ployed by Sarbin 


Madame Curie and in another session 
that Mae West \ third 


Rorschach was while the S 


she was 


given 


was under hypnosis without any spe- 
that 


cihc suggestion 2 found 
the S tended to adopt 


posed by the hypnotic 


the set 
instructions, 


im- 


so that half of her responses in the 
Madame Curie instructions concerned 
while two thirds of her re- 
the Mae West set 
sisted of clothing and 
sociations The control Rorschach, 
given in the waking state, contained 
only two responses found in the hyp- 


science 
sponses inf con- 


costume as- 
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trance states. Hypnosis has 
also been used to study a ze regression 
Bergmann, Graham, & Leavitt, 
1947 The test respouses of a 20- 
year-old S, given the Rorschach for 
the eight alternate years between 3 


and 20, seemed to reflect the various 


notK 


stages in the development of his per- 
sonality 

Two used the Rorschach 
with Ss who had been instructed un 


studies 


der hypnosis to feel hostile toward 
Counts & Mensh, 1950 
lo illustrate the difh 


the examiner 
Pattie, 1954 
culties involved in using hypnosis for 
this purpose, the conclusions in one 
study were different from those in the 
other Counts and Mensh (1950 
found that the hostility to the & 
which appeared during the psychi- 
atric interview was not reflected in the 
Rorschach, while Pattie (1954) could 
14 Ss into 3 
(N=8) showed a 
hostile 
Rorschach 
ber of white space responses did not 
the 
A considerable degree of indi- 


divide his 
of which 


groups, one 
two-fold 
the 


increase in content in 


posthy pnoti The num- 


increase under hostile instruc- 
tions 
vidual differences was also found by 
Arluck and Balinsky (1953) who 
used as the hypnotic suggestion ‘‘you 
are mature, warm and outgoing,” 
ete For 
both the Ror 


completion test showed numerous dif- 


some Ss the responses on 


schach and a sentence 
ferences with prehypnotic test rec- 
ords, but for others the two sessions 
produced highly similar results 
Qualitative and dif- 
ferences following the hypnotic in- 


quantitative 


duction of an elated mood and a 


despondent mood were found on a 
word association test (Fisher & Mar- 
row, 1934) 


longest for unpleasantly toned words 


The reactions times were 


and were fastest for neutral words 
Special and experience 
Several have 


gated 


training 
experiments investi 


the influence of perceptual 
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scores 


pre Ror- 


Rorschach 
prov ded 


training upon 
Knopf (1954) 
schach perceptual training in find- 
ing animal or animal parts for one 
group of Ss while the second group 
watched a film on the nature of color 
He concluded that 
ture of the personality remained bas 
Kurtz and Riggs 


found no differences 


the over-all pi 


i¢ ally 
(1954 


in group Rorschach scores in Ss who 


unchanged 
similarly 


had first been exposed to a visual set 
to perceive animals. ‘So far as this 
study is concerned, Rorschach work- 
the 


that implicit peripheral sets will not 


ers remain secure in assumption 
influence test results to any ippreci 
469 Nor did Nor 
and Redlo (1952 


Rorschach scores were al- 


able extent’’ (p 
man, Leverant, 
find that 
tered by having one group of Ss first 
look at colored food ads while another 
group looked at pictures ol people in 
motion Evidence that perceptual 
training can influence Rorschach per 
formance has been reported by Keyes 
1954 Leventhal (1956 Sub 
jects trained on stimuli similar to the 
Street Gestalt 
the number of 
the group 
Keyes, 1954 raining on the 
idministra 


and 


pictures produced 
increase in whole 
sponses on 
( sort. 
schaldt figures before an 
tion of the group Rorschach resulted 
in lower HW’ and Z s Leventhal. 
1956 


res 


Giving children a “gratifvi 


penence prior to testing See ry 


the Draw 


ry Ha 


improve perlormance on 
\-Person test (Reichenb« 
1953 (1947) showed a 
neutrally toned film to children the 
evening before they took the second 
half of the TAT. Of the 
told after the film only one « 
flected the content of the { 
ble (1945) gave the Rorschach 
twice, once in the standard office pro 


kett. 


Coleman 


370 stories 
learly re 
Kim 

test 


cedure and once in the college cafe- 


terias with at least two other people 
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Che test results were quite 
similar in the two situations, the 
most important difference occurring 
in the experience balance, more color 
responses being given in the social 
situation. Gibby, Stotsky, and Miller 
(1954) concluded that the experience 
of taking a psychological test (Ben- 
der-Gestalt, TAT, Wechsler-Belle- 
vue, or Goldstein-Scheerer) immedi- 
ately before an administration of the 
Rorschach did not alter any of 11 se- 
lected Rorschach variables. 
Deprivation or arousal of needs 
The effects of hunger on associations 


present 


to ambiguous stimuli have received 
the attention of three investigators 
School children showed more food as- 
sociations on a word association test 
shortly before a regular meal than on 
the test given after the meal (San- 
ford, 1936 Undergraduates who 
had fasted for 24 hours before tak- 


ing five projective tests gave more 


food responses than did Ss who had 


ibstained from food for shorter pe- 
riods of time. The increase was not a 
straight line function of time, how- 
ever, the most hungry Ss giving only 
slightly than 
the groups examined the end 
of a normal eating cycle (Sanford, 
1937 and McClelland 
(1948) were able to derive a food 
score on TAT stories that could dif- 
ferentiate reliably among groups de- 
prived of food for 1, 4, or 16 hours 
While there was no increase in food 


more food responses 


near 


Atkinson 


imagery in these stories, there was a 
marked increase in food deprivation 
themes. While the TAT may be able 
to reflect a state of food deprivation 
the Franklin and Brozek 
(1949) indicated that the Rosenzweig 
P-F test responses of a group of con 


report of 


scientious objectors did not change 
significantly from a period of semi- 
starvation to a state of nutritional re- 
habilitation 


Iwo studies investigated the elf- 


fects of motor inhibition on the pro- 
duction of movement responses in 
the Rorschach test. Korchin, Meltz- 
off, and Singer (1951) resi ricted nor- 
mal motor behavior in their Ss by 
having them write a standard phrase 
as slowly as possible. Singer, Meltz- 
off, and Goldman (1952) reduced the 
motor behavior of Ss by requesting 
them to stand for five minutes with- 
out moving. In each experiment, the 
Ss denied motor activity gave more 
movement responses than a control 
group. However, Singer et al. (1952) 
also found that increasing motor be- 
havior 
minutes of vigorous calisthenics) did 


by having Ss engage in five 


not reduce the number of movement 
responses. 

The relationship of experimentally 
aroused needs on projective test re- 
sponses has also been investigated. 
When the need for achievement was 
induced by means of ego-involving 
instructions, stories of college men 
increased in. achievement imagery 
themes and themes of instrumental 
acts and attitudes related to achieve- 
ment (McClelland, Clark, Roby, & 
Atkinson, 1949). The stories told by 
high school boys to pictures of male 
figures also showed an increased num- 
ber of themes related to achievement 
as a result of special achievement 
These achieve- 
ment arousing conditions, however, 
were efiective in increasing 
achievement themes of either high 
school girls or coilege girls (Veroff, 
Wilcox, & Atkinson, 1953). 

A sociometric test given prior 
to the administration of the TAT 
seemed to increase themes related to 
the affiliation motive (Shipley & Ver- 
off, 1952; Atkinson, Heyns, & Veroff, 
1953). Freshmen who were rejected 
for membership in a fraternity gave 
more affiliation themes on the TAT 
than students who were accepted into 
fraternities (Shipley & Veroff, 1952). 


arousing conditions. 


not 
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Clark (1952) attempted to raise the 
level of sexual motivation by show- 
ing Ss slides of nude females before 
rAl \ 
group was shown slides of landscapes 
the 
shown the slides of the nudes gave 


administering the control 


Under these conditions group 
fewer manifest sexual responses and 
than the con 
when the experi 
after all the Ss 


a beer party, the 


fewer themes of guilt 
trol Ss However 
ment was repeated 
had participated in 
experimental group gave more stories 


Oi Ma 


Ss 


iftest sex and guilt than those 
who had been shown the lands« ipe 
ibi Nelson, and ( 
had one group of undergradu 


to the Ror 


dec 


slides R, lark 
1954 

ate male iting take 
iin ft t room 
charts and 


secon ! 


orated with anatomical 


surgi al pictures a group 


ore fortu: ther 


to 


somewhat n ite iv 


assignment experimental cond- 


tions, was seated in a room deco 


rated with photographs of nude and 
the control group 


waited in an undecorated 


While 


tween groups 1! 


seminude fen ale 7 


room 
be 


the number of anato 


there was no diff nce 


my responses, there was t 


difference in the number of sexual re 


a signincat! 
sponses 


THe INFLUENCI F THE EXAMINER 


While the evidence 


factors in 


ed 


regarding situ- 
projec tive testing 
been cor pil over the ve 


ars 


the studies de iling with interpersor il 


. 
nfl 
influences 1s ot 


(su 
this 


rather recent 
lford s 1947 study 


ireéa an it 


origin 
was the first 
was three vears be 


lore the next experiments were re 
Ihe relative neglect oft this 


lack 


since 


ported 
proble m was not entirely due to 
ol awareness of its importance, 
McFarlane (1942 


the 


inter 
the cli 


wrote that 


pretation in hands of 


ically inexperienced, the doctrinaire, 


or the methodologically uninformed 


é isily degenerates into nothi y more 


MASLIN 


but one more predic tive tool to wil, 
the 


interpre 


discloses 
the 
than the organizing dynamics of the 
research subject” (p. 405 ind Joel 
1949) that “even if it were 


possible for the examiner always a¢ 


one which organizing 


dynamics of ter rather 


warned 


nds he 


the 


tually to feel the way } prete 
does, we should not tors that 
ly ine ex 


subject reacts not o1 am 


ner's real attitude, but so to what 
he thinks the examiner ittitude is 
p. 480). Probably th “st deter 
rents to ¢ xploratior 
the tacts tha 
E influence 
the X-ray concept ot 
and the 


tlety of 


juest 
were 
struck 
extre me comp! 
the interpers« 
ation, so aptly disc 
1954 
cult 


The 


pothesis that Es we 


lade experi 


stucdie 


hirst 


they 


resipon 


[ ses 
the hles of 
to deter! 

ot fs 
Ss 


were 
response such ph 


ot 7.8 as Sk n color S17 


vestigated, as well 


V iriables revealed 
tests venerally ti 
interaction oO 
studied 
by 
sion contrasting 
with present with 
with & absent 

A ce mpletel ( 
this problem is thro 


While no s 


to 


flere 


hypnosis 
nosis 


primarily 


testing relatior ship ex 


its using hyp report 


with 


perimet 
that S's 
the hypnoti 


test behavior 

suggestior hus far 

(sro 1959: Wick 
} | } 


ittempted to estab n wer 


‘ ] twe tudies 


es, 1956 
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ant conditioning of S’s verbal behav 
ior, but this method seems so promis- 
ing that undoubtedly it will become 


more widely used in investigating ex 
miner influence 
examiner ysical character 

diately apparet 
the £ are his ski 
build. Each ol 
attributes has been investigated 
the S's re 


related 


color, sex, and body 
these 
for possible influence on 
the 
to sexual responses on the 
Alden and Benton 
selected 100 Rorschach re 


files of a VA hospital 


them 


5 Three studies 

i i 
rschach test 
1951 


tne 


vert sex 


attrib 


overt 

oY 
even mak 
heant difter 


abin e al 


nd that mes the sex 


lakes a difter 
yt The 
Rors« h if 
lecor anatomical 
number 


to the 


+} 
rie 


vive 


' ' 
s, but those male 
| 


a Toom Ggeco 


rude women 
sexual 
than to 
found that 
sexual 
responses 
than to an at 
seductive, female - 
of the E's 


\-Person produc 


a male / 
rather 
size 


IL he influence 


d sex on Draw 


tions were investigated by Holtzman 


PR 


‘ECTIVE TESTING 


1952) who found that none of his 12 
judges could guess better than chance 
of the 
Es by inspecting the drawings of 40 
ale and 40 female Ss 
ks, of whom was nearly a foot 


taller and 


either the sex or the identity 


n Iwo male 
one 
60 pou ids heavier than the 


is differing in 
were 
Melker 
and two male 
rAT to 54 male 
Neither the sex ol 
nor the interaction of the 
ind S produced significant dif- 
rences in the stor ~ 
Schw: 
investig 
ind 
white stimulus 
ad 


other, and two female 

; leminit qualit 
ld, Blek, 
ised two female 
rim 


d 56 temal 


degree ol ies,” 


(sarte ind 
ister the 
Ss 


sex 


Riess a ( ottingham 


1950 


rtz,. a 
ited the 


Ss 


responses ol 
Negro and 
rAl 

a Negro and white 

ided that 


negre white to 


hgures on cards 
niniste red by 
skin color of 
the length of 
ivestigators 
the & in 

Rankin 
their 


skin 


a Negro and 


atiect 


s While 
the influence of 
verbalized test resp 


and Campbell (1955 


most 1 
look for 
nses, 
used as 
nt variable the galvani 
Ss to 
1 word association situa- 

FE checked an 
dummy 
to left 

| that there was a higher difter- 


ae ile 


1 adjusted on 
asions 


S's 


equipment 
wrist It was 
ential galvanic skin response to the 


he 


ind 27 pounds 
i; 


Negro Q, but 


, 7 
oider;©r, > itl 


since was 9 years 


} hes taller 
there was 
the differe 


skin color 


the white 
vof that 


; 


function ol 


heavier than 


no conciusive pre 


ence Was a 
Presence 
from the tes 
1956) found that 1 


the absen« e 


or abdsen of examiner 


ing Bernstein 
V1 
of the & 


themes, 


stories writ- 


ten more tre- 


quently contained sad sad 
outcomes, and showed greater S in- 
written 
with the & present in the testing room. 


H-T-P 


secured from applicants for employ- 


volvement than stories 


Certain aspects of drawings 
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ment at a state school were found to 
be a function of the E's presence when 
the test was taken. Total size of the 
drawing, house size, house features, 


and 


nihcantly between the group taking 


person features all differed sig 


the test with E present and the group 


the E- absent 
Burns, 


tested 


taking the test with 
Cassel, Johns & 1958 

Van Krevelen 1954b 20 Ss 
with 2 cards of the MAPS series; one 


the 


was dictated to 


her and 


was her absence 


’ 
+} 


ly significant difference be 


that the 


written u 


the two grot 
" 


ips was 
the 


Is in the 


imbDiguous ofl two cards 


ed more writte! 


nt sit 


wort 
he absence of 


efiect 


lation 
have 
test results (Var 


The Ss 


See! ed to nore 


on Szon Krevele 


1954a 


stered 


, 
selves 
showed gre: 
strated more 


had a open and 


when £& 


and 


plus-min 


behavior. Luft 
varied the interaction between 
I d a by ait tir 


ind friendly 


r SS al an blur to 
lhe col 


teraction con 


social 


their 


askin the Ss 
ber and draft 
hort 
e.g., “Which 
Derby 
tering 10 homemade ink blots 
the Ss were asked which inkblots they 


urrent 
the 
before adn s 


When 


a 5 


juIz on ¢ 
horse won 


Kent icky 


! 


liked and disliked, the 
group treated in the warm fashion in 
dicated that thev liked 
blots, while the cold Ss liked only a 
mean of 3.1 blots. 
cant beyond the 
1950 


which they 
a mean of 7.6 


i difference signifi- 
001 Lord 
used three styles of adminis- 
tering the Rorschach 
tive, and negative 


level 


1eutral, posi- 
and three female 


next movement response am 
forw ird in 


MASLIN( 


Es. In the positive interaction E was 
instructed to look at S with a smile 
the 
for & to 


and to be warm and charming 


negative interaction called 


the role of a harsh, demand 


ing, authoritative hgure, deliberately 


assume 
unconcerned about S. Each S took 
the Rorschach three times with the 
order of - and administratior 

ter! \s f the dil 


tn <s ot the 


a result « 
flere: 
prot 


ninistration 


interaction 


ocols icited irom tl 
produced 
sponses, more evidence of 
imaginatior 
tion ol steroty ped think 
creased evidence of gre 


interpersonal! relations 


t 
idministr itor responses i! 


imaginative, creative think 


there appe ired to be 
emotion 

a rise in se 

condi: 


Odberant onine 
pe 7H reine 


verbal behavior wo studies investi 
gated the extent to which S's associ 
blots could be deter 
the E's beh ivior WW ke 


used 30 homem ide u 


ations to ink 
mined by 
(1956 kblots 
two Es 


v ided 


and 36 undergraduate Ss di 
into two experiment 
ind one control group 
group the fir 
given in the standar 
with ( 16 the E said 
the first movement response 
t the 


perimental 
were 


ird 


! movement 
the 


response, making 


secon 
ind “‘all right” to 
ment 
ments in regular sequence 
of the testing In 


perimental 


the s 
first 15 


standard 


group the 


were given in ashi 
ird 16 the E made var 


and gestural cha yes, nod 


with ¢ 


ous 


postural 


ding his head three times to the first 


movement response, smiling on the 
1 ke ining 


the chair after the third 
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movement response, repeating this 
sequence to the end of the testing. 
When the responses on the first 15 
and second 15 cards were compared 
for all groups, it was found that the 
experimental group given verbal re- 
significant in- 
025 level) in movement re- 
sponses on the half of the 
test, the experimental group given 
postural reinforcement made a sig- 
nificant increase (.005 level) in move- 


inforcement made a 
crease 


second 


ment responses in the second half of 
the test, while there was no difference 
movement re- 


in the number of 


sponses in the control group. Gross 
1959) verbally 
one group of Ss for each human re 
the while for 


i second group he nodded his head 


reinforced (‘‘good”’ 


sponse on Rorsch ich 
once following each human response 
Both the 
and the nonverbally reinforced group 


verbally reinforced group 


produced more uman responses 
than a control group. 

The «fect of the examiner as a per- 
on: mo assessment of examiner per- 
In a report net seen by the 
writer, but Lord (1950) 
and others, Guilford (1947) 


concluded that some Es elicited more 


onality. 
quoted by 
con- 


responses froc: their Ss in administer- 
ing the Rorschach test than other Es 
Baughman (1951) also noted that cer- 
tain Es seemed to produce more re- 
Rorschach cate- 

He selected 633 


in selected 


yores than other Es 


protocols secured by 15 Es from the 


files of a veteran's outpatient clinic, 
and found 12 of 22 scoring categories 
differing significantly at the .001 level, 
with four additional differences sig- 
the .05 level. Unfortu- 
nately, the protoc ols were not scored 


nincant at 


by the investigator, so that the differ- 
ences found may have resulted from 
the psychologists’ procedures in scor- 
ing, rather than from their influence 
on S. Both Wickes (1956) and Bern- 
(195¢ two £s in their 


stein used 


studies and each concluded that the 
psychologists did not exert any sig- 
nificant influence on the Ss’ responses. 

To control for some of the sources 
of variation in responding to the Ror- 
schach, Gibby (1952) had 9 Es use a 
standardized inquiry in testing 135 
Ss. Despite this, significant differ- 
ences in responses were found for 6 
of the 11 determinants investigated. 
“The stimulus value of. the examiner 
therefore must be considered a factor 
which the inquiry re- 
sponses of the subject and therefore 
the final Rorschach psychogram. 
Standardization of the inquiry does 
not eliminate examiner differeiices”’ 
p. 452). An attempt was made by 
Gibby, Miller, and Walker (1953) to 
secure a homogeneous group of pa- 
tients whose Rorschach records could 
be analyzed fc: E All Ss 
used were male veterans, white, 25 
rather 


influences 


influence. 


had functional 
than organic ailments, and were the 


32 years old, 


most recent 
All 12 
lyzed had a minimum of two years 
Beck's Rorschach 
method and had tested at least 20 
Ss who met the criteria for the study. 
All protocols were coded and scored 
blindly. 
which were investigated, three were 
significant at the .05 level or better, 
the & percentage scores, 3 
significant at the .05 level or 
better. The investigators concluded 
that ‘“‘there are over-all 
differences in the determinants ob- 
tained by from 
comparable groups of subjects. 

It is also probable that certain ex- 


patients tested by E. 
Es whose records were ana- 


experience, used 


Of the nine absolute scores 


and of 
were 


signihcant 


various examiners 


aminers tend to obtain successively 
dysphoric records while others with 
comparable patients will seldom elicit 
such reactions” (p. 426). 

Robinson and Cohen (1954) exam- 
ined the case reports prepared by 
three psychological interns. The last 
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30 reports for each of the three in- 
terns were examined for the variables 
of dependence, independence, aggres 
sion, and abasement. When the inci 
dence of these variables in the case 
each of 
the three psychologists, 6 of the 12 
significant at the 


reports was compared lor 


were 
When 
these variables were considered, 12 
of the 24 
the .05 


‘ ompar isons 
.O5 level components ol 


comparisons were signin 
confidence 
that 


‘a serious question 


cant at level of 


rhe 


this study 


investigators com luded 


raises 


about the objectivity of methods ol 


evaluation and prediction if they 


must rely solely upon psychological 
reports tor their basis” p 335 
The effect of the examiner as a per 


[essed 


1953 


son; examiner personaitly a 


Hammer and Piotrowski 


asked three staff psychologists and 
three interns to rate 400 H-T-P draw 
ings on a 3-pcint scale of aggression 
Ihe clinicians were themselves rated 
by one of the investigators on the de 
gree ol aggression ind hostility they 
manifested in dealing with patients 
In addition, the 
Szond: test 


Deri for 


and staft members 
| the 
Susan 


licians also took 


which was scored by 
degree of hostile and aggressive in 
pulses. A rank order correlation of 
94 was found tor the degree of hos 
w in the H-T-P 
made 


he 


tests 


tility the clinicians sa 
productions and the evaluation 
ot their il hostility 
the clinicians’ Szondi 


interpersor 
rating ol 
t rank order correlation 
their evaluations of the 
The authors 
subject's 


tex h 


also yielded 
of .94 with 
hostility in the H-T-P 
that 


periormance on a 


concluded ‘just as a 
projective 
nique is a function of his personality 
his needs, conflicts, desires and past 
experiences, 80 too, although to a les 
ser degree, is the interpretation ol! a 
projective proto ol influenced by the 
the interpre 

(1952 


per sonality pattern ol 


ter’’ (p. 214-215 Filet ana 
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lyzed 156 case reports submitted by 
13 male clinicians for references to 
hostility, hostility turned 


passive dependency, I 


inward, 
and feelings ol 
Evaluations were also 


behavior 


inferiority 


obtained of the clinician's 


| 


ascencency cepression 


in terms of 
intropunitiveness, extrapunitiveness 
and impunitiveness. The results indi 
cated a complex relationship betwee 
the judgments of the clinician and 
the judgments made by the 

For example, Es who stre 

tility 


pre ssed and intr punitive 


turned inward were 


relerences 
; 


rate study ol 


mechanisms indicate 
most frequently me 
il were more char 
EE than the test S 
Berger 1954 


Rorschach results of eight 


sms 


used the personal 
\ \ trai 
} 


compare with the Rorschach 


ees ti 


records these Es elicited from VA pa 


; 


ontrary to the f ings oO 


most other studies, Berger | 
differences } 
on 12 variables in the 


is. However 


Significant 
p itive 
} 


whe I iM 


his Ss were r k-ordere 


12 variables a rho correlat 
was found for the number « 
a rho of 801 


responses 
responses al da rho 
responses 

Lord (1950) did not 
make a formal assessmet 
sonalities of her three fema 
she obtained des riptions of them at 
a subjective, intuitive level t1 
clinicians, relating these desct 
to the Rorschach 
trom Ss rhe first / 


the judges is a cold, i 


espe 
f ' 


culine, castrating we 
Rorschachs from her Ss th 
appear that they had faced a thr 
ening, trustrating situatio 
second FE, described as the most fem 


nine of the group, the softest 
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like, 


suggested 


elicited Rorschach 
her Ss had 


excitement 


mother 
that 
under 


most 
records 
been controlled 
without great anxiety or tension and 
had not been greatly stimulated in 
The third — was the old- 


three and was described as 


tellectually 
est of the 
the most flexible, exuberant, sympa 


thetic, intermediate in feminine qual 


Her Ss 


gested that they had been challenged 


ities Rorschach records sug 


nd made anxious, but there was also 


evidence of easy rapport and a rela 
ibsence of controlling devices 


rAl MMPI i ! 


records oft 
were evaluated 


tive 
I he 
nine sks 


a 


and 
and com 
with the Rorschach responses 
Es had elicited An 


2 of 37 


analysis of 


iriance showed selected 


signihcant at 


Miller, Sand 


1950 


Rorschach variables 


the .05 level or better 


ers w 
nd « leve land 


leveland Sanders 
1953) trained nine 


id vear graduate students to ad 


ter the Rorschach test after first 


il Rorschach 


person iron 


' 
i period of training, each 
stered 20 Rorschachs to un 
derg? wiuate Ss it the end of each 


testing session 5S was isked to rate 


isures I I anxiety and 
{ ks’ covert 
were obtained 
il Rorschach 
nul ber 0 
each S 


is found 


was 

that of the 
nvestigated, 9 differed 
The Es rated 
xiety by their Ss 


ntly among és 
overt il 
elicited more responses white 


more 


space responses ind more 
sponses that those rated low in overt 
No ditterences in Ss’ 


anxiety scores 


scores ol 

The Es 
their Ss 
the 


and 


could be accounted for by 


the Es or 


rated 


covert anxiety 


high on hostility by 


elicited greater ¥“, and A% in 


Rorschachs they administered 


secured less hostile and human con 
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tent than those Ks whose Ss rated 
them low 


tion times seemed slower when E was 


in hostility. The Ss’ reac- 


perceived as hostile, a finding in 
ayreement with the observation made 
of the test behavior of Ss with hyp 
hostility to E 

1950; Pattie, 

personal Ror 
hostility, 
it was found that the more hostile /s 
elicited less y' 


tile content and more human content 


notically induced 

Counts & Mensh, 
1954) When Es’ 
schachs were examined for 
Or less A‘ o, more hos 
hos- 
that 
provide 


than those Es with low 
tility 


The 


evidence 


covert 

The authors concluded 
results of this study 
that 


on the Rorschach test 


a subject Ss responses 
are not solely a 
product of his own emotional prob- 
lems and personality structure’ \p 
4> While the investigators clearly 
indicated that & 
the test 
that the 


as a person Can in 
they esti- 
this influ 


only 3-7% of 


fluence results, 


mated extent ol 


ence can account tor 
the total variance in the Rorschach 


scores 


[HE INFLUENCE OF 


W hile 


agreement 


THE SUBJECT 


there is wide 
that 


Situation 


theoretical 
the 
influence 


each party in 


testing exerts an 


on the other, the experimental evi- 


dence is limited almost entirely to the 


effect / 
reason for the 


has on S. Perhaps the chief 


failure to investigate 


the manner in which S can inflwence 
the psy hologist is the lack of tradi- 
tional experimental procedures that 

in afford control of the S's behavior 


while the 


E's behavior is allowed to 
study in this area 
controlled S's 


havior by using attractive female ac- 


I he one 


1957 


Vary 
Masling, be- 
complices who posed as test Ss, act- 
ing The de- 
pendent variable was the interpreta- 


warm of to F 


tion placed on sentence completion 


protocols by eight graduate student 
Es. It was found that when S acted 
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warm to E her protocol was inter- 
preted more favorably (i.e., she was 
seen in better mental health) than 
when she acted cold. In addition, 
the results that when E 
saw two Ss, one of whom was cold 
and the other warm, the protocol of 
the warm S was interpreted more 
favorably than that of the cold S 


indicated 


DiIsCUSSION 


The studies presented in this paper 
have reviewed rather 
ically, with the emphasis on content 


been uncrit- 
rather than on adequacy of experi- 
mental design. Since faulty experi- 
mental procedures appear with regu- 
in the studies in this area, it 
worthwhile to examine 
the more commonly 
found limitations in design: 

1. No study 
sively sampled the E population. As 
Hammond (1954 
resentative design demands that both 


larity 
might be 
more closely 
reviewed here exten- 


has indicated, rep- 


E and S populations be adequately 
sampled if generalizations are to be 
nade to larger groups of S and E 
Most studies cited here, however, 
utilized only one E, with only Baugh- 
man (1951) using as many as 15 Es. 
The general results of the work on E 
differences makes clear how tenuous 
it is to assume that one E is drawn 
from the population as any 
other E 

2. Not only has the E population 
been inadequately sampled, but the 
little attention given to Es has been 
directed for the most part to grad- 
While it is legitimate 
student 


Same 


uate students 
to work with a 
population it is inappropriate to gen- 
eralize findings to a population of 
older, more experienced Fs 

3. Those which 
gated the influence of E differences 
by utilizing a random sample of cases 
found in the files of a clinic, make the 
assumption as Levy (1956) has indi 


graduate 


studies investi- 


cated, that the cases were originally 
assigned on a random basis. This as- 
sumption may not always be valid, 
due to differences in E schedules, in 
terests, and competence. Asa result 
differences in test records may be in 
part a function of uncontrolled bias 
in the selection of Ss. It is far better 
procedure for the investigator to con 
trol the assignment of cases than to 
assume existing cases had been ran 
domly assigned 

4. A frequent method of assessing 
E personality has been to ask the & 
As the 


quite 


to take a psychological test 
this 
clear, the orientation S has toward 
the 
responses 


results of review take 


test considerably influences his 


Few graduate student 


ssvchology are naive regardir ” the 
> K 


more common projective tests, even 
if they have never seen them before 
The Rorschach 


taken by a graduate student, there 
fore, is unclear and cannot be easily 


meaning of a test 


related to differences in Ss’ responses 
A better way of evaluating E's per 
sonality obtain judg 


ments by his 


might be to 
supervisors and col- 
leagues. Another method that shows 
promise is that used by Sanders and 
Cleveland (1953), who asked the test 
Ss to make ratings of their impres 
s10ns of E 

5. Most investigations of suscepti 
bility of Ss’ responses to situational 
influence have been conducted em 
pir ally, with no prior attempt ma le 
to predict where differences would be 
found Rorschach 
has been particularly culpable in this 
Since the Rorschach is still 


rather than 


Research on the 


regard 
primarily an empirically, 
theoretically . based instrument, most 
investigators have attempted to de- 
termine only if differences would oc- 
cur between experimental and con 
but, on 


trol finding differ- 
ences, have been unable to inte rpret 


As a result of this ap- 


groups, 


their meaning 
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proach, almost every Rorschach score 
has at one time or another been found 
to be a function of some experimen- 
tal variable: Z, W, W%, Ds, D, Dd%, 
F—, F+%, F% FM, m, M, CF, C, 
Y, ¥Y%, A, A%, P, R, reaction time 
and experience balance have all been 
reported to change as a result of ex- 


perimental conditions 

6. Many of the Rorschach studies 
appearing before Cronbach's (1949 
Rors« hac h 
the 
sponses, but assumed that all differ- 


research did 
of re- 


critique of 


not control for number 
be at- 


Vari- 


ences in determinants could 

tributed to the experimenta! 
able. To a large extent investigators 
now attempt to partial out differ- 
the 
but an occasional study will still dis 
While most of the 
other statistical errors Cronbach dis- 


ences in number of responses, 


regard this factor 


cussed occur far less frequently in 


later research, inflation of proba- 


bilit: 


source of error 


levels continues to be a major 


the 


studies cited here presented strong 


Despite these flaws in design 


evidence of situational and inter- 
personal influences in projec tive test- 
ing. It is important. to note, how- 
ever, that the projective 
did not change with any and all con 
| by the / The use 


produced only 


response 


ditions if p™ . 


of drugs minimal 
changes in the protocol and there was 
conflicting evidence regarding the im- 
portance of such physical differences 
among £s as skin color, sex and size. 
What appeared to be the crucial ele 
ment the which S's 
attitude toward the fotal testing situ- 
ition was influenced by the experi 
mental conditions. Where the exper- 


imental variable was peripheral to the 


was extent to 


examination, as in Coleman's (1947 
showing of a film the night before ad 
ministering the TAT, no appreciable 
effect was introduced in the protocol; 


when the condition was sufficiently 


unique and sufficiently contiguous to 
the testing session, as in the use of a 
waiting room decorated with pictures 
of nude women (Rabin, Nelson, & 
Clark, 1954), Ss evidently construed 
the experimental conditions to be a 
part of the total testing situation. 
There is considerable evidence that 
Ss in an unstructured situation will 
utilize all available cues to complete 
their assigned task rhe S in the 
projective test setting will not only 
use those cues furnished by the ink 
blot or picture, but also those sup- 
plied by his feelings about the ex- 
aminer, those furnished by his needs, 
attitudes and fears, those implied in 
the instructions, the room, and previ- 
ous knowledge of the test, and those 
cues supplied consciously or uncon- 
sciously by &. When E faces the am- 
biguous situation of supplying mean- 
ing to a series of isolated, discrete re- 
sponses, he will not only rely on S's 
responses, but also on those cues fur- 
nished by his training and theoretical 
orientation, his own needs and ex- 
pectations, his feelings about S and 
the constructions he places on S's 
test behavior and attitudes. In short, 
these that E 
and S behave as we should expect, 


studies demonstrate 
considering our knowledge of behav- 
ior in ambiguous settings 
Thus, the procedure that 
clinicians hoped would serve as an 


many 


X ray proves, on close examination, 
to function also as a mirror, reflecting 
impartially S, E, the situation and 
their interactions. This need not be 
a cause for despair, except for those 
who feel that E and situational influ- 
These 
not sources of error, 


ences contaminate a protocol 
influences are 
however, but indications of adapta- 
tion to the task. One reason for the 
poor record of blind analysis as a pro- 
cedure for validating projective de- 
vices is that this method can utilize 
only a fraction of the material avail- 
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ible in a protocol. Instead of trying prompt an S to rely heavily on inter 
to eliminate inte rperso! il i d situa person il cues, nor do we K w much 
FE might better make of the forces acting on an E who is 


tional influence 
his own’ faced with a belligerent, or overly 


i more thorough search of 
ittitudes and of S's attitudes toward cooperative or suspicious S Most 
the test and the situation (Leventhal important ill, the 

Rosenblatt, Gluck, & Slepian 1958 the studi | here 
The interpersonal situation ‘‘i 1 " that ia 


evil. It should not be strive 


As in psychoanalys idu i protocol, without in any 
p must be regarded these variable 
as a potentially signih j How S senses 
n the patient how £ realizes S 
1o1 and as a possible go 


trol him can only 


studying the inter 


material for interpretatior 
ter, 1954, p 6 el It 8 Interest! 
rhe important problems in this idy reviewed her 


irea remain unsolved Wh ‘Trect t ) j the 
does experience have on / 
tivits I 


what 
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NOTE ON THE MULTITRAIT-MULTIMETHOD MATRIX 
LLOYD G. HUMPHREYS 


University of TUinois 


he recent article by Campbell different methods is implicit in 
and Fiske (1959) is stimulating and man. It has also been sugges 


sound, but one of their conclusions several measurement theorists s 


can be supplemented to indicate a quent to Spearman, but 


for further re- been followed explicitly 


desirable direction 
as follows ior test construction Yet 


search They conclude 

‘‘Measures of the same trait should ing the present status of per 
correlate higher with each other than measurement, one might we 

they do with measures of different clude that this procedure constitutes 
traits involving separate methods. our only hope in this area 

Ideally, these validity values should Consider the following four 


also be higher than the correlations a hypothetic il rotated tactor 


xl Method Method Methu 


, 


1\ 


among different traits measure Ihe correlation betwee 
the same method.’ There no 
with their first criterion, an he same trait, is onl 


hedged bv the use of f ition between 1 


id 2 both assumed 


ing 
their second is 
“ideally I ven so the second is too 
strong. It is the purpose of this note 


not re 


to show that the seco 
imount 
sume that Variables 3 throu 


ly a function of the num showr ilso have load 


better characterized as 


yf importance to be 
is simp 


ber of different methods that n ral ind each has a k 
used to measure the trait of the succeedi 


rhe procedure required to handle tors (Factors Ill 


the problem posed by correlations Similarly Variables 


between measures of difierent traits, have loadings of .40 or 
} 


itilizing the same method, that are method loadings of .80 o 
higher than the correlations between factors If we now 
easures oO tre 5 i¢ trait 


Kt 
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12. the 
following factor 
ined by 


tions of sums 


two agvregates will have the 
loadings, as deter- 
correla- 


the formula for 


methods 
24 and the 
s hav 

| 


atiol by 


‘ . 
ol the or 


$5, bec iuse the 


cm im common, 
with an equally 
ime trait 1s 

in ¢ ynclude 
have psy 
which make 
il tools for 
ng these two 
further im 


eth xis, 


criterion ofl 
ist hold if this 
Beyond 
abil 


methods of 


to be successful 


ds entirely on our 
enough 
for each trait in which 
The number of 
in a parti ilar 
pend on he the 
ire when 
methods Vary, as 


held cor int and 


opposed to how high the intercorre 
“ he I rhe thod is held con 
vary 


In discussing so glibly the problem 
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of increasing the number of methods 
whith measure the trait in question, 
the writer does not intend to convey 
the impression that the problem is 


Method Method Method Method 


itl I\ \ VI 


ne empirically. Quite the 
but the difficulty of 
the search should not deter us. After 
all, we can hardly point with pride 
lished in the 
the attempt to 


oO 


true, 


reverse 15 


to what we have acc omp 


personality realm in 


find good trait measures defined by 
methods 


sit ole 


The reader should not conclude 


that 
obtain 


igvrevating across methods to 
better trait 
the 


ipplication of this pro- 


measures 18 re- 


stricted to personality realm. 
sSystemati 
cedure to aptitude measurement is 
Guilford’s 


1956 


ilso desirable inalysis of 


the ability domain could serve 
which di- 


should be 


constructing socially 


as the basis for deciding 


mension or dimensiotr 5 
vided across in 
or scientifically useful trait measures. 
lhis is in contrast to a point of view, 
held by Guil- 
separate 

Thus, 
test, it 


which is apparently 
ford, that 


test ior every ce 


recom nends a 
ll in his table 
in constructing a reasoning 
be desirable to 
methods, e.g 


might aggregate 


across , series, analogies, 
and across 
hg- 
The fact 


ibility can be fractionated is 


and classification items; 


content, e.g., words, numbers, 


ures, letters, and objects 


that an 
insufficient basis for concluding that 
1 be 


t how ir ictionated 
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